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1.  The  Task.  We  shall  study  the  problem  of  object  identification  against  a 
background  of  clutter  and  using  laser  radar  for  obtaining  range  data.  The 
algorithm  shall  attempt  to  classify  the  object  or  objects  in  the  scene.  It  may  also 
be  able  to  do  the  detection  but  this  is  not  the  primary  goal  since,  in  a  multiple 
sensor  situation,  this  may  be  better  done  by  other  sensors.  ^ 

c — "  ~  " 

The  algorithms  shall  be  flexible  so  that  they  can  easily  be  modified  to 
incorporate  changes  in  technology  (as  long  as  range  data  are  supplied).  In 
particular,  if  the  accuracy  of  the  range  determinations  improves  drastically, 

only  minor  changes  will  be  needed  in  the  code.  ^ 

^ - '  ”  "  '  - 

To  make  this  possible  the  code  is  made  highly  modular,  so  that  only  one,  or 

a  fe.  ,  of  the  smaller  modules  need  be  replaced  by  other  modules  (also  supplied)  in 

addition,  of  course,  to  changing  parameter  values, 

Our  approach  is  actually  based  on  the  assumption  that  much  higher  accuracy 

in  range  data  will  soon  be  achieved.  It  should  then  also  be  possible  to  recognize 

partially  hidden  objects.  The  main  ideas  in  the  code  have  been  chosen  with  this 

future  task  in  mind. 

Since  at  present  we  have  few  real  images  with  reliable  range  data  we  have 
had  to  build  a  terrain-object-noise  simulator  to  produce  data  on  which  the 
algorithmic  ideas  can  be  tried  and  which  will  also  be  useful  for  debugging  the 


programs. 

Simulated  data  are  good  for  this  purpose,  but  they  are  not  enough  since  the 
model  on  which  the  simulation  is  based  must  be  tested  against  reality.  It  is 
therefore  necessary  to  try  the  programs  on  real  and  reliable  range  pictures  when 
they  become  available,  leading  no  doubt  to  modifications. 

The  code  has  been  written  in  APL.  The  reason  for  using  this  unconventional 
programming  language  is  that  its  logical  structure,  which  is  based  on  some  of  the 
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fundamental  concepts  of  mathematics,  makes  it  ideal  for  mathematical 
experimentation.  The  drawback  is  that  the  fact  that  it  is  interpreted,  rather 
than  compiled,  makes  it  run  much  slower  than,  for  example,  optimized 
compiled  FORTRAN  code.  In  experiments  on  the  computer  this  can  be 
accepted  -  once  good  performance  has  been  achieved  the  algorithms  may  be 
rewritten  into  some  other  language  or  implemented  through  special  hardware. 

2.  Generation  of  background.  The  scenery  will  be  made  up  of  large  scale 
features  and  of  smaller  details.  The  former,  that  can  partially  or  wholly  obscure 
the  objects  and  may  also  sometimes  confuse  the  algorithm  by  appearing  ’object 
like’,  will  be  chosen  as  random  elevations  of  fairly  smooth  appearance. 

The  centers  of  the  elevations  will  form  a  random  process  in  the  x,y-plane 
on  which  objects  will  be  placed.  The  user  specifies  the  number  of  them 
(right  argument  in  the  functions  GENTERRAIN  and  GENSCENE)  but  the 
locations,  heights,  and  horizontal  shape  cross  section  are  generated  at  random 
by  the  algorithm. 

The  height/width  ratio  can  be  controlled  (in  a  probabilistic  sense)  by 
choosing  a  suitable  power  as  the  exponent  in  line  [22]  of  GENTERRAIN.  The 
present  value  is  .5  which  produces  fairly  sharp  outlines,  a  bit  like  trees.  Other 
values  will  produce  the  appearances  of  hills  in  a  rolling  landscape.  This  is  also 
influenced  by  CMAX/CMIN  for  height  distribution  and  by  the  parameters  AMIN, 
AMAX,BMIN,BMAX  that  control  the  cross  sections. 

The  small  scale  features  in  the  background  are  more  chaotic,  at  present  just 
white  noise,  with  standard  deviation  called  SMALLSCALE  in  line  [7]  of 
GENSCENE.  This  could  easily  be  replaced  by  a  stationary  stochastic  process  with, 
say,  a  fairly  but  not  completely,  flat  spectral  density. 
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Linc  [5]  was  inserted  in  order  to  let  the  user  choose  a  particular  probabilistic 
behavior  for  the  sky  portion  of  the  scene.  At  present  it  is  not  used,  setting  LSKY 
equal  to  zero. 

After  the  background  is  generated  the  program  interrogates  the  user  about 
placing  objects  (see  next  section),  and  then  adds  noise  to  the  range  data  computed 
by  the  function  SIGHT1.  The  latter  computes  the  true  ranges,  taking  possible 
obscurations  into  account  and  using  a  depression  angle  called  PSI,  assumed  small. 

The  error  level  in  the  range  sensor  on  the  background  is  denoted  by  BACK.- 
GROUNDERROR  and  on  the  objects  by  OBJECTERROR.  Judging  by  the  few. 
real  pictures  we  have  seen  the  former  is  much  bigger  than  the  latter.  If  this 
changes  in  the  further  development  of  laser  radar  some  of  the  modules  in  the  code 
should  be  replaced  as  will  be  discussed  in  section  12. 

&  Generation  of  object  shapes.  The  number  of  object  shapes  used,  called 
NOBJECTS,  was  only  six  in  the  following  experiments  but  can  be  set  by  the  user 
to  any  value  he  wishes. 

To  prepare  for  bigger  values  and  to  facilitate  entering  the  shape  we  have 
prepared  the  functions  GENOBJECT,  COLLECT,  INSIDE,  SCALING.  They  enable 
the  user  to  present  any  object  of  polygonal  shape:  he  is  prompted  by  the  program 
to  type  the  coordinates  of  the  vertices  and  the  programs  do  the  rest.  For  more 
details  in  using  these  and  other  programs,  see  section  8. 

In  the  experiment  we  used  the  object  shapes  shown  in  section  10, 
representing  front  and  side  view  of  a  tank,  front  and  side  view  of  a  small  stylized 
house,  and  two  side  views  of  vehicles.  We  used  polygons  with  few  vertices, 
which  may  have  been  psychologically  wrong,  since  the  appearance  of  the  object 
boundaries  will  be  too  straight  and  simple.  In  future  experiments  one  should  use 
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more  detailed  polygonal  or  spline  representations  of  the  shapes  -  this  will  also 
make  it  easier  for  recognition  algorithms. 

The  program  PLACE  places  objects  in  the  x,y  planed  at  desired  location  for 
the  midpoint  of  the  lower,  horizontal  part  of  their  boundary  and  at  height  2=0. 
This  implies  that  height  variation  in  the  background  (vegetation,  small  hills,  etc.) 
will  normally  hide  the  lower  horizo..  al  part  of  the  boundary  which  therefore  will 
not  help  in  discrimination.  This  effect  was  not  planned  but  showed  up  in  many 
of  the  experiments.  It  is  not  clear  if  this  is  a  realistic  effect. 

Main  approach.  The  logical  organization  is  based  on  ideas  presented  in  the 
two  working  papers  enclosed  as  Appi ;  dix  1  and  2,  but  modified  in  two  respects: 

(i)  we  now  assume  range  information  rather  than  IR  or  visible  light 
images, 

(ii)  we  assume  low  accuracy  (at  least  for  the  time  being)  that  seems  to  rule 
out  the  sophisticated  algorithms  that  was  proposed  in  Appendix  2. 

We  arc  preparing  for  the  time  when  improvements  in  the  accuracy  of  range 
data  will  be  made,  enabling  us  to  deal  with  obscuration.  This  of  course  implies 
that  algorithms  must  be  based  on  local  features,  since  global  ones  may  be  hidden 
from  sight. 

We  shall  think  of  a  scene  as  presented  in  a  deformed  image 

ID  =  D{R[o(go,g1,...gn.1)]) 

Here  the  generators  gj  are  local  features,  actually  arc  elements  making  up  the 
parts  that  can  be  seen  of  the  boundaries  of  the  objects  in  the  scene.  The 
connector  graph  o  joins  arc  elements  in  the  appropriate  order  along  the  (partial) 
boundaries  of  each  object.  Thus  o  will  not  be  connected  if  several  objects  are 
present  in  the  scene. 
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Thc  operator  R  takes  the  configuration  o(gQ>g i »— Sn_ i )  into  a  set:  the  part  of 
the  scene  consisting  of  objects  as  it  appears  in  the  image  plane  of  the  sensor. 

The  deformation  mechanism  D  takes  the  set  mentioned  and  transforms  it  into 
range  data  adding  observational  noise. 

Our  task  is  to  recognize  the  objects  and  this  will  be  done  in  terms  of  tiic 

♦ 

generators  gj  and  the  connector  graph  o.  In  other  words  we  need  estimators  g^  of 
arcs  g:  generator  estimates.  We  shall  do  this  by  choosing  a  collection  {g£}  of  shape 
elements,  each  consisting  of  a  small  binary  picture,  a  template,  say  of  size 
LTEMPX  by  LTEMPY.  In  the  experiments  below  we  chose  LTEMPX  =  LTEMPY 
=  11  but  this  may  not  have  been  a  wise  choice. 

We  postpone  the  important  problem  of  how  to  select  {gk}  until  section  5.  If 
we  tried  to  superimpose  each  gk  at  each  pixel  in  our  image,  and  then  test  for 
goodness  of  fit,  the  results  of  the  tests  should  tell  us  a  good  deal  about 
hypothetical  locations  of  objects. 

But  this  is  clearly  wasteful,  since  only  a  small  part  of  the  picture  will 
normally  belong  to  object  boundaries.  Instead  we  proceed  in  steps  as  follows  to 
reduce  CPU  time. 

4.1.  Since  BACKGROUNDERROR  »  OBJECTERROR  the  local  variation 
in  grey  level  is  much  smaller  on  the  objects  than  off;  this  is  seen  clearly  in  the 
real  pictures. 

Exploit  this  by  finding,  at  each  pixel,  if  the  variance  of  the  pixel  values  at 
the  1+8  values  (8  neighbors)  is  large  or  small.  Keep  only  the  latter  ones.  This  is 
very  fast  and  is  done  by  the  function  CHANGE  as  called  in  statement  [10]  of 


TESTS  1. 


-6 


4.2.  We  now  have  a  binary  image.  To  remove  from  consideration  isolated 
or  nearly  isolated  points  in  the  set  defined  by  the  binary  image  =  1,  we  apply 
CLEAN  which  eliminates  points  with  less  than  FEW  neighbors.  This  is  also  very 
fast. 


4.3.  Compute  the  boundary  of  the  binary  image,  applying  the  function 
IBOUNDARY.  The  resulting,  much  thinner,  binary  image  is  then  represented  as  a 
2-column  matrix  with  x  and  y  coordinates  of  the  boundary  obtained;  this  is 
carried  out  by  the  function  COORD  in  line  [11]  of  TESTS  1.  This  is  even  faster. 

4.4,  We  now  move  the  shane  elements  gk  to  each  point  remaining  in  the 
binary  image  after  Step  4.2  and  test  the  fit  by  computing  the  (counting)  measure 
of  the  symmetric  difference 

mk(x,y)  =  m(gk,  subpicturc  at  x,y). 

This  is  done  in  statements  [14]-[27]  of  TEST1.  Here  NSLICE  denotes  the  range  of 
4 

k  in  {gk}  and  we  sweep  the  boundary  completely,  except  when  we  are  very  close  to 

the  border  of  the  image  where  room  is  not  available  for  placing  any  shape  element 

* 

gk:  statements  [12]-[18]  take  care  of  that  exception. 

In  [11]  we  compute  a  crucial  parameter,  THRESHOLD  which  is  proportional 
to  the  size  of  any  shape  element,  LTEMPX  x  LTEMPY.  The  proportionality 
constant*  called  K,  is  crucial.  We  have  used  values  in  the  range  80%  -  95%.  It 
determines  whether 

mk(x,y)  >  K  x  LTEMPX  x  LTLEMPY 

when  we  accept  the  shape  element  temporarily  for  further  hypothesis  testing,  or 


not. 


-7- 


This  step  is  time  consuming  and  takes  a  good  deal  of  the  whole  CPU  time 
used  by  the  driver  RECOGNIZE. 

The  result  of  TESTS1  is  a  vector  TESTSEL,  of  k-valucs  for  temporarily 
accepted  shape  elements,  and  a  2-column  matrix  TESTSLOC  of  their  locations. 

4.5.  We  now  try  to  reconcile  the  information  in  the  test  results  TESTSEL 
and  TESTSLCC  with  the  corresponding  lists  associated  with  each  hypothetical 
object.  In  Appendix  2  we  suggested  that  this  matching  be  done  by  stochastic 
relaxation,  a  suggestion  that  has  not  been  implemented.  We  believe  that  in  the 
future,  when  advances  in  sensor  technology  will  support  more  refined  methods, 
that  may  be  the  way  to  go.  At  present  we  are  rescued  by  the  fact  that  we  need  not 
do  subgraph  matching,  which  is  notoriously  hard  to  compute.  Instead  we  match 
subsets  of  two  geometries. 

Each  of  the  points  (xj.yj)  in  TESTSLOC  carries  a  label  kj  of  the  shape 
£ 

element  gk.  that  it  supports.  Similarly  at  each  location  (u^,vj)  of  the  hypothesis 
lists  HYPLOC  there  is  a  label  of  its  shape  element  gj;..  We  want  to  match  the 
relative  positions 

(Xj,y  j)  =  (uj.vj)  +  offset. 

We  shall  do  this  by  brute  force,  trying  all  combinations  for  the  offset.  This 
is  clearly  wasteful  and  we  shall  return  to  this  later. 

For  each  hypothesis  the  function  FULLTEST  tries  all  combinations  for 
offset,  lines  [8]-[9]  keeping  track  of  the  number  of  agreements  obtained  and  saving 
the  largest  number.  We  also  compute  a  vector  KEEP  intended  for  later  use  to 
successfully  remove  elements  from  the  testlists;  this  has  not  been  implemented  yet 


however. 
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This  step  is  the  most  time  consuming  in  the  whole  algorithm,  especially  if  K 
is  small  like  80%  when  the  testlists  tend  to  becom ;  excessively  large. 

4.6.  The  rest  of  RECOGNIZE  collects  the  accumulated  evidence  and  prints, 
either  nothing  when  no  object  has  been  detected,  or,  in  the  opposite  case  a  list  of 
possible  objects  and  their  hypothetical  locations,  lines  [15]-[26],  in  decreasing  order 
of  credibility.  The  number  of  agreements  found  between  subset  of  the  testlist  and 
a  subset  of  a  hypothesis  list  is  printed  as  the  credibility.  Very  unlikely 
hypothetical  objects  are  not  printed. 

In  the  present  form  of  the  algorithm  several  objects  are  allowed  in  the  scene, 
but  not  more  than  one  occurrence  of  each  object  type.  This  restriction  can  be 
removed  by  using  the  vector  KEEP  mentioned  above. 

In  lines  [27]-[40]  hypotheses  are  removed  that  would  involve  centering  objects 
so  close  that  it  is  physically  impossible.  The  minimum  distance  is  a  global 
variable  called  MINDIST. 

5.  Optimal  Selection  of  Shape  Elements.  In  the  early  stages  of  developing  the 
program  TESTS1  and  its  forerunner  TESTS  we  used  arbitrarily  selected  shape 
elements  where  the  sets  were  chosen  as  rectangles,  triangles,  and  squares  with 
different  locations  and  orientation  in  the  LTEMPX  x  LTEMPY  square. 

This  seemed  to  work  fairly  well,  but  TEST1  often  missed  to  fit  the  shape 
elements  even  in  cases  where  the  picture,  displayed  on  the  monitor,  looked  clear 
enough.  This  this  reason  we  tried  to  choose  the  shave  elements  in  a  more  systematic 
manner. 

Given  the  shape  element,  to  use  it  as  an  estimator  of  location  is  not  a  new 
mathematical  topic.  It  was  studied  in  U.  Grenander  (1978):  Pattern  Analysis, 
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Springer-Verlag,  section  5.1,  although  with  a  different  deformation  mechanisms. 
That  sort  o£  theoretical  analysis  ought  tofc  carried  out  for  the  present  situation, 
since  it  may  lead  to  better  microsiatistics.  see  Appendix  1*. 

rex 

<«K 

Let  X  be  the  space  of  all  possible  shape  elements,  and  say  that  we  are  given 
a  very  large  sample  xj,X2,...xn  from  some  probability  distribution  P  over  X.  Of 
course  X  is  a  discrete  space,  but  of  enormous  cardinality,  in  our-case  21  ,  so  that 

we  shall  allow  ourselves  to  treat  P  as  given.,  by  a  (~£oars.e  grained’)  density  f,  in 

- 


some  vague  sense  continuous.  We  weg^iike  to  select  y^^Vj*xV2VVxvp^?:l»x2**xn^ 

where  p  «  n.  The^x...  will  serve  as  our  shaper eleiAentsj  and  in  order  that  they 

•  -  vi  -  r 

f  *  ■  -  "  •  •  TF  ' 

serve  well,  we  should.  lef.Xj-,X2,...xn  be  all  or  most  of  the  shape  elements  that  occur 

_ »-  *  - 

for  the  given  objects.  IP - 

- 

But  that  will  lead  to  excessive  CPU  time  requirements:  we  cannot  test  all 
the  shape  elements  xj.  Instead  we  use  only  the  selected  ones  and  hope  to  cover  the 
most  important  part  of  X,  namely  the  Lehessue  set 

L(c)  =  {x  |  f(x)  *  c)  CX. 

To  estimate  the  set  L(c)  is  a  problem  in  abstract  inference  and  closely  related 
to  Theorem  4.1  in  section  5.4  of  Grenander  (ibid.).  We  shall  use  the  following 
procedure. 

Choose  a  radius  r,  (denoted  by  the  global  variable  RADIUS  in  the  code)  and 


solve 


max  N(xj,r);  N(xj,r)  =  #{xj  in  ball  centered  at  xj  and  of  radius  r) 
i 

Select  xVj  where  Vj  realizes  the  max.  Remove  all  x’s  from  that  ball,  maximize  the 
N-function,  which  is  proportional  to  a  coarse  grained  density,  giving  xv^  and  con¬ 
tinue  until  p  shape  elements  have  been  selected. 
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Rcmark,  It  seems  likely  (but  not  proven)  that  this  can  be  formalized  by  a 
theorem  saying  when  and  how  estimates  the  Lebesgue  set  in  a  general 
situation.  It  is  actually  a  sieve  estimator  and  can  be  expected  to  be  consistent  if 
we  let  p**“  slowly  compared  to  n-*“  and  simultaneously  r  t  0. 

This  is  implemented  in  two  steps. 

5.1.  We, first  form  the  long  list  (xj)  by  calling  the  program  FINDGENS.  It 

operates  on  the  3-diiirensibnal  array  ALLOBJECTS  containing  all  t»H>ject  shapes, 
and  takes  all  ,the  shape  elements,  separated  by  a  distance  caljfd  DIST  along  the 
respective- boundaries.  :•  ,  •  Z 

It  calle^%fTe“auxniary  functions  SELECT  and  SCREEN,  that^sej&rates  points 
^  ^  '  - 
along  the  boundary,  and  the  function  NINBALL  which  computes  the  coarse 

grained  density. 

5.2,  The  second  step  is  to  do  the  estimation  of  the  Lebesgue  set,  which  is 
implemented  by  the  function  LEBESGUE  that  takes  as  input  the  global  variable 
SLICES  created  by 

SLICES  -  FINDGENS 

It  does  what  was  described  above,  but  in  addition  it  deletes  shape  elements  that 
contain  too  many  zeroes  or  too  many  ones.  The  reason  for  this  is  that  such 
extreme  shape  elements  have  too  low  inferential  power  as  estimators;  it  is  done  in 
statements  [18]-[19]. 

This  construction  of  an  optimal  set  of  shape  elements  requires  a  lot  of  CPU 


time,  but  can  be  done  off  line. 
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6.  Utilities.  When  experimenting  with  the  recognition  algorithms  it  is  useful 
to  display  pictures,  say  of  small  LX  x  LY  dimension,  quickly  even  if  crudely. 
This  is  done  by  the  function  display. 

Since  matrix  coordinates  are  oriented  differently  from  the  usual  Cartesian 
system  we  should  apply  TURN  to  a  matrix  before  displaying  it. 

To  see  a  binary  matrix  directly  do 

SEE  MATRIX 

To  sca|e  a  digital  picture  from  level  0  to  NLEVEL  do 
IMAGE  -  NLEVEL  SCALE  IMAGE. 

Some  statistical  tests  have  been  implemented  for  use  in  the  early  version 
TEST  and  RECOGNIZER 

’  STUDENT:  Student’s  two  sample  test 

■  FISHER:  Fisher’s  Z-test 

.  KOLMOGOROV:  Kolmogorov-Smirnov’s  two  sample  test 
To  display  all  the  selected  shape  elements  execute  SEEGENS. 

The  function  WHITE  produces  a  field  of  standardized  white  Gaussian  noise. 
Since  memory  limitations  prevented  us  from  doing  this  by  a  fast  APL  algorithm 
based  on  3-dimensional  arrays  it  has  been  done  by  looping  and  is  therefore  quite 
slow. 

Remark.  This  approach  shares  some  features  with  the  other  recognition 
algorithm  that  our  group  at  Mathematical  Technologies  Inc.  (Brown  University 
and  University  of  Massachusetts)  has  been  developing.  In  particular  they  both  use 
some  sort  of  local  test  that  are  ultimately  combined  to  make  the  global  decision 
about  objects  in  the  picture. 
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The  present  algorithm  differs  from  the  other  one  in  that  it  is  based  on 
com mited  shape  elements,  it  avjtids  a  complete  scan  by  shape  dements  over  all  or 
most  of  the  picture,  and  the  details  of  the  final  matching  -  the  decision  .function. 

In  TESTS  we  employed  brute  force  computation  for  finding  matches  between 
the  pre-computed  shape  elements  and  the  observed  picture.  It  called  the  function 
VIEW  (or  alternatively  VIEW1  for  a  correlation  test)  which  sweeps  the  entire 
picture  with  a  step  called  STEP.  It  was  found  necessary  4$  make  STEP  small,  at 
most  =  4,  better  =  2,  to  get  acceptable  performance.  This  step  in  the  preliminary 


version  of  the- decisionjj|snctioa  required  massive  CPU  time. 

It  was  followed  by  executing  SEARCH,  which  finds  all  the  major  local 
maxima,  separated  by  a  distance  .called  DIST,  This  step  is  fast. 

To  get  better  performance  TESTS  was  replaced  by  TESTS1,  to  be  described 
below.  This  not  only  improved  the  performance  but  reduced  CPU  time  by  a 
factor  10. 


7.  Experiments.  We  now  begin  experimenting  with  the  code  for  detection/ 
recognition.  The  first,  very  preliminary  experiments,  used  RECOGNIZER  and 
TESTS  employing  one  of  three  statistical  tests. 

It  was  not  very  surprising  that  STUDENT  did  not  give  good  performance. 
After  all  the  model  used  in  the  simulator  tries  to  mimic  one  aspect  of  the  current 
state  of  laser  radar  technology:  the  signal  from  the  background  is  very  noisy. 
Hence  a  test  for  distinguishing  the  two  mean  levels  in  the  on/off  parts  of  the 
shape  element  can  be  expected  to  have  low  power. 

On  the  other  hand  we  had  hoped  that  the  Kolmogorov-Smirnov  test  would 
perform  well.  This  was  not  the  case,  however,  for  reasons  that  are  not  yet  well 


understood. 
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Fisher’s  Z-test,  for  distinguishing  between  the  two  variances  in  the  on/off 
parts  was  much  better.  It  required  a  lot  of  CPU  time,  however,  at  least  in  the 
interpreted  APL  code,  so  that  we  therefore  modified  the  algorithm  to  the  one  in 
RECOGNIZE  and  TESTS1.  We  shall  not  report  the  preliminary  experiments:  all 
the  following  ones  use  RECOGNIZE. 

The  experiments  were  coded  as  follows. 

EXPi  means  no  object  present,  POWER=i 
EXPji  means  object  no.  j  present,  POWER=i 
EXPDkhji  means  objects  k  and  j  present,  POWER=i  . 

The  letter  D  stands  for  double.  If  the  letter  M  occurs  it  signifies  that  CMAX=20 
rather  than  the  default  value  10,  leading  to  larger  obstructing  features  in  the 
landscape.  If  the  code  ends  with  A,B,  or  C  it  means  an  earlier  experiment  has 
been  replicated  but  with  NHILLS  larger  than  the  default  value  4. 

7.1.  We  begin  by  testing  the  detector  on  scenes  without  any  objects. 

EXP3. 
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I 

The  algorithm  prints  nothing;  no  detection  is  claimed. 
EXP3MA.  Here  NHILLS=6  with  the  result 


A.B.C , - 
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A.B.C  = 

8.39912928  22.17009896  4.549721174 
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and  one  can  see  the  biggest  one  (the  first  above)  clearly  in  the  picture: 


No  detection  claimed  by  RECOGNIZER. 


EXP3MB.  With  NHILLS«8,  otherwise  the  same,  we  get 
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xo.ro  = 
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A.B.C  = 
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and  the  two  biggest  features  are  seen  iu  the  simulated  background 


No  detection  claimed.  '*r 

EXP  IMA,  HjgUJiow  .lower  the  exponent  in  the  power  law  for  the  probability 
distribution  for  the  height.of  the  landscape  features.  This  will  produce  a  more 
irregular  terrain,  as  iihseon  in 
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We  see  three  big  features,  one  dominating  the  scene: 


No  detection  is  claimed,  although  one,  fairly  small,  feature  resembles  object  no.  1. 
Finally, 


EXP1MB.  With  NHILLS=8  gives  an  even  more  irregular  landscape 
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in  which  wc  can  see  several  features,  one  broad  and  high,  another  very  thin 


No  detection  made. 


In  these,  and  many  other  experiments  with  no  object,  we  found  no  case  with 
false  alarm.  This  is  not  necessarily  good  since  it  may  mean  the  algorithm  is  too 
conservative:  it  may  miss  some  objects  when  actually  present.  We  should  keep 
this  in  mind  later  on. 

7.2.  We  now  place  an  object  in  the  scenery  and  will  look  at  what  happens 
for  the  six  object jihapes  we  have  used  (see  section  10  for  their  appearance). 


With  NHILLS=4  here  and  in  most  of  the  following  experiments  we  get, 


after  placing  object  no.  0  in  the  middle  of  picture: 
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With  an  earlier  form  of  RECOGNIZE  we  get  the  decision 


RECQGiilZE  EXPO  IB 

ALC-CRITUll  DECIDES  CREDIBILITY  OF  HYPOTHESIS: 
OBJECT  l!0,  0 
AT  LOCATIOl!  6  8  70 
TO  BE  =  33 
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which  is  the  correct  one, 


** 
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EXPOi.  This  is  very  similar,  but  CMAX  has  been  lowered  to  10  so  that 
landscape  features  are  less  visible: 
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with  the  simulated  range  picture  looking  like: 


24 


The  algorithm  makes  the  right  decision: 


rscocuizn  n::ro  i 

ALConir:::'  nnciDsr.  cp.udidili::::  or  ::ydcp::. 
cr.~::cr  .  o 
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We  now  place  object  no.  1  in  the  landscape.  It  is  smaller  and  hence  more 
difficult  to  detect/recognize. 


EXP11.  With  POWER«=ll,  NHILLS=4  tie  simulator  produces  main  features 
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resulting  in  a  picture  like 


which  is  correctly  identified  by  the  algorithm: 


eegog::ize  e::f  11 

ALGCRITHl, :  DECIDES  CREDIBILITY  OF  HYPOTHESIS : 
OBJECT  UO.  1 
AT  LGCATICU  61  69 
TO  BE  =  13 


This  is  satisfying  but  it  should  be  observed  that  this  was  done  with  CMAX*10  (no 
M  at  end  of  name  of  experiment)  so  that  there  was  no  big  features  to  confuse  the 
decision  function. 

EXP22.  Placing  object  no.  2  and  with  power  level  2  in  the  exponent  the 
simulator  gives 
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looking  like 


27 


and  with  the  decision 


RECOG VISE  EXP 22 

tfjGQii ITiL.  L EC IDE 5  CREDIBILITY  OP 
OBJECT  VO.  2 
XV  LOO  XT  1 01:  6  4  6  3 

to  r r  =17 


’SU/ 


Now  we  make  it  harder  for  the  decision  function  by  choosing  CMAX=20, 
POWER=l.  Placing  object  no.  3 


EXP31M,  The  simulator  generators 
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RBCOGBIZB  EZP31M 

ALGORITHM  DECIDES  CREDIBILITY  OF  HYPOTHESIS : 
OBJECT  HO,  3  ' 

/.£•  LCCATIOiJ  6  5  77 
S£7  =  43 


~ -~1Mt  With  object  no-  4  thc  simulator  produces  a  very  ’hilly’  landscape 
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OBJECT  ? 
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ALLOBJECTSL^nl 
FLACE  OBJECTS? 
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0: 

0 

with  the  decision 

EE  CO  SEIZE  EXP  MI! 

ALGO  HIT  ELI  DECIDES  CREDIBILITY  OF  HIPOTFESIS : 
OBJECT  UO.  0 
AT  LOCATIQE  70  71 
TO  BE  =  6 


This  is  wrong,  the  object  is  no.  4.  The  reason  for  the  mistake  is  obviously  that 
too  much  of  the  object  has  been  hidden  by  one  of  the  main  features  in  the 
landscape.  With  the  current  noise  assumptions  the  recognition  algorithm  is  not 
able  to  cope  with  this  amount  of  obscuration. 
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Detection  was  achieved  correctly. 


EXP43.  To  see  how  the  recognition  algorithm  handles  the  shape  of  object 
no.  4  in  a  less  chaotic  background  we  lower  CMAX  to  10,  momentarily,  and  get 
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looking  like 
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and  the  decision  function  then  succeeds: 
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with  the  appearance 


Note  that  the  object  is  again  obscured  partially 
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This  means  that  the  algorithm  could  not  make  up  its  mind  which  of  objects  1,2, 


and  5  to  choose. 
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place  objects? 
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looking  like 


RBCOGBIZB  EXP DO ^2 

'ALGORITHM  DECIDES  CREDIBILITY  OF  HYPOTHESIS : 
OBJECT  110.  4 
AT  LOCATION  56  S3 
TO  EE  =  2V 


so  that  object  no.  4  is  correctly  identified,  but  object  no.  0  is  not  even  detected. 
The  reason  for  this  is  unclear.  The  lower  horizontal  boundary  of  it  is  hidden  by 
low  level  obscuration,  but  this  is  always  the  case  in  these  experiments,  and  does 
not  seem  to  seriously  affect  the  power  of  the  detection/recognition  function. 
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^•^.ovy  o"-  -=- 
"7:tr„  jvir  -. 

_  7 '  -.,  •  "  - 
/Li  7-1^  -  ’ 

54;.72'0'C7o22 

3-o^iua 


:?***  ^ 

l-.6i»#2W3-47  ¥8V9  50  24  80  «f 


/•  0  > .  0  — 

4  11 

:-.:/\7;  objects? 

E.'iTJZR  0  £•?  1 


LCCATICE  ? 

L: 

37  37 

objec t  ? 

;3 

PLAGE  OBJECTS? 

APS!: CP.  0  OR  1 


LOCATE OP  ? 

Li: 

85  70 
OBJECT  ? 

L: 

/ILI.CIVL’CT.S'CS :  : 

;;] 

Pi/JCT  OBJECTS? 

AH  SUEZ  C  0i?  1 


and  the  range  data  picture  is 


Here  detection/recognition  is  perfect 


ALGORITHM  DECIDES  CREDIBILITY  OF  HYPOTHEC 
OBJECT  VQ .  1 
AT  LOCATIOP  34  42 
TO  BE  =  13 


.  o  ^  L-i. 


ALC-OR  IT  Ell  DECrn 
OBJECT  110.  3 


,•?  v :?  "ii  ?  <5 
u  /x  i.  i,  i  . 5  o 

ES  CREDIBILITY 


AT  LOCATIOP  C-G-  84 
0/5  r?  n  ~  o 


or  in  pc- tee 


Note,  however,  that  the  credibility  of  hypothesis  object  no.  I  i, 
lower  than  39. 


EX  PD?  52. 
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Now 


j:::^L2Z2^ci:r£.crrr:  4 

~  Jk^+c  =  ■  <  ' 


-  ;il-.745G147G  20  .55120745  2.9535S3003 
2-0  - 


<  r 

i.  s  -i .»  >  V 


2-7 .201*7  36  2  0  6.34450712  6 .13*?045J'.GC 
"i'CUi'O  =  ....  'i 

.  "  J12  .115  ■ 

•aM^c  *  ^  v.  -•  .  >vt  ; 

•-  ■^■•*7-™LSC'4  23-. 1-5205734.  0.3211CS47IF 


tirxln 

/-  U  *  _  =  ' 

'i-o  icv$tY 


-sf 


.  -  .  -JS6  ** 


’V-  • 


£-•  •  «.&o-ss  3-5  *  4  7..ss  c.o  s  «t .  s  1 7  7  cVs  2 1 


i  ,  L'fr* 

*r&#&£M**SSl  jt 


s 

.  .  .  ^>;S  - . 


::r.£cr  objects? 
s::s:  !ee  0  o>?  1 
C : 

1 

LOCATION  ? 

L; 

37  37 

object  ? 

n. 

k.  • 

,:i-£0Sc7i?C2\?[2;  ;3 
W/.CT  OBJECTS? 

A  EGVEE  0  Oi?  1 


7.QCATZ0V  ? 

95  70 

C EJECT  ? 

r„ 


-  w*. — 


/’BBOB/BC’BSC  5  .;  ;  ] 


PI.-iCB  OBJECTS? 
fJCVEE  0  OP  1 


with  the  appearance 


0 


39 


and,  again,  a  correct  decision 


RZC0GVIZ3  CZPD2 52 
s.LGonrjni;  uncivnc  cehdi 
Cucject  no ».  5 

AT  LGCATIOr  22  7  5 
20  32  =  13 


02 


ALGQP.ITVi:  DECIDES  CREDIBILITY  OF 
OBJECT  110,  2 
AT  LOCATIGi:  3  4  43 
TO  BE  -  14 


X-  —  L  ..  .  ,  L/  J.  S.  « 


Now  let  us  make  it  harder  by  putting  CMAX  *-  20. 


EXPD2S3M.  n;:?S2*3::+Gr,!Scx  r  4 

.i.r.c  = 

i2.700CCG2£  22 . 047177 12  13.ICC37787 
.YC.7C  = 

121  ice 

••  •  •<  %c  — 

5. 22573522  IQ. 42487*5  1.004025SP4 

.Yo.ro  = 

120  23 

it  %C  ~ 

17.3352531  2.G00C2032  2.010775642 

::o.ro  = 


/l.i-.C  = 

20.3  3503452  2C.32C1S.53  15.03004546 

ro.ro  = 

51  62 

place  objects? 

Ai'SntF;  0  OP.  1 


ICCATIOU  ? 

Li: 

45  45 

OBJECT  ? 

\  !  • 

ALLOBjnCTSi2iil 
PLACE  OBJECTS? 

A  USE  BP.  0  Of:  1 


EETPI  ERROR 


locative  ? 


C5  75 
OBJECT  ? 

f  * 

us 

ALLS  EJECT Si  5 ; ; ] 
PLACE  OBJECTS? 

AiJounr.  o  op:  i 
L: 


with  the  picture 


> 
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Thc  decision  is  correct: 


RECCC-UIZE  EZPD2SZU 

ALGORITEu  DECIDES  CREDIBILITY  OF  HI  PC  CHESTS : 
0  EJECT  UO,  2 
AT  LOCATIOll  47  54 
TO  BE  =  4S 

ALGORITHM  DECIDES  CtT  ....LITE  OF  HYPOTHESIS : 
OBJECT  UO,  5 
AT  LOCATIOll  CO  S2 
TO  BE  s  45 


EXPDQ33M.  We  now  made  a  cosmetic  change  in  the  code.  We  now  print  out  the 
credibilities  of  all  object  hypothesis  above  a  certain  level  (N AGREE)  and  also  the 


final  decision. 
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For 


iljtQSgSTlS'S  ~5vS5-6  C-51 32  --S vC- C5-4&05  Sfi. 
G  4f: 


i.  i..  tC  = 

5.CC-D77S54  2G.£iG4?G2  C.0CC1C41C2 
.  zo  ;ro  = 

.,,.C,S-C  ..  S'-  . 


LOCATION  ? 

* 

42  4  c 
r.T.T~f'r‘  9 

/.£^/Vi7WE0  8SJ 

p.-t.-tt  czjzc: 

TZ  0  Cl:  i 


r,CC/S-C 


■7  9 


05  75 
0 oJ lCT  ? 

D: 

/.CLCSJZCPSCS;;] 

cr  crpi’crcr 

ABSVSS  0  CZ  1 

n. 


and 


o 


the  algorithm  mistakes  object  3  for  object  1. 
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kl-co seize  eepdq  z  ze 

alc-ceith:  decides  curDir-iEia  or  eipotee 
oldest  no.  o 
lcca.tiof  se.  si 

TO  =  3  f. 

alcceite::  decides  ceedieiliti  of  nipoinn 
object  no.  4 

n  -  pp  /  ■  77' n  c-.n 

w  J4  a  Xl't.  0  #r  !*•  U 

:•£  :r  =  33 

^M’jrrrr  Ti-'f  ~  rii~  '  (1:v’07T7r7',i''  /•■ -»  ;•  —  7 ■  ■ 

rr .  3 

locatiod  cs  ss 
::s  :?:■•  =  32 

AECOP.ITEE  DECIDES  CP.EDIEILITE  OF  HI  POL'S.' 
(EJECT  DO.  2 

10  CAT  1 01:  GG  GO 
TO  EE  =  2G 


a  zoo  tit::::  decides  cp.edidilitd  of  depot:. 

OBJECT  DO.  5 

/:r?  gg  si 

=  25 


'.T  r  r: : 


A.  0,00  PIT  EE  DECIDES  CEEDIIILITE  OF  IlXPPTl 
C "SECT  DO.  1 
/.T  LOCATIOD  3  5  51 
TO  EE  =13 


IS: 


ED  SELT  OF  DEC  IS  101:  FVDCTIOD 
OBJECT  DO.  0 

LOCATIOD  86  91 

tit::  cp.edieiliti  35 

OBJECT  DO.  1 
AT  LOCATIVE  35  51 
WITH  CEEDIEILITI  13 


To  look  more  closely  into  this  we  lowered  the  threshold  constant  K  from 


90%  agreement  to  85%.  We  then  got  the  correct  decision 


iinilHIti1 


::rcc  c-uzze  erfdc  z  z!) 


/.ego  liter  decides  credhilub  or  bbbctbbszc 
:  eject  no.  3 

.\r  ICC ATI 0"  36  86 
iy  c  i:l '  =  50 

/.Ifi-CiCl-uL  l/til+JLiJist1  Lhi.uli.ALtl.;.-.  Ll  i  i  j.UL t.uul  O  » 

OBJECT  HO.  4 

lccatioe  so  cs 

t  .a  —  c  c 

*•  l  »i  ™  D  O 

•  -  <*•/'»  ->  tti  •  n  i  n  -r  **i~»  n  f*  ^ 7*  7  7>  7 ''  T  r*  *  •  ~  i •  —  r»  r  T  • 

i  «C  i-i  .  -  U^U  L-  i.~i  1‘  A  l>  A  uL  «  v.-/.  *  l  S  ^  .i,  w  A  ‘  - 

object  no.  o 

..."  LCCATIOE  42  51 
:."■  S7  =  53 

.'.v^c w?crz>3£  credibility  or  eipc tresis: 

object  no.  5 

L0C/.TI01:  40  50 

cc  rr  =  *:-6 

corns  a?  decides  credibility  cf  eyfcteisic: 

OBJECT  no.  2 
at  zocatice  sg  cs 

i,-’  IP  *  42 

algo  rite::  decides  crfeidilitb  or  EiFoi./rsii: 

OBJECT  no.  1 

L0CATI01:  3G  51 
TO  BE  =  34 


RESULT  OF  DECISICI!  FUUCTIOi!  IS: 

^  *  ‘  r  pah  ;■»/■»  o 
l/Jt  i<  v  •  O 

.‘1L’  LOCATZOl!  86  06 
r,T27?  CREDIBILITY  5  0 

OBJECT  110.  0 

/."  LOCATIOl !  42  51 

i7If£  CREDIBILITY  5  3 

This  turned  out  to  improve  performance.  The  reason  is  of  course  that  it 
allows  for  high  noise  level.  However,  it  tends  to  make  the  lists  TESTSEL  and 

TESTSLOC  a  good  deal  longer,  which  requires  more  CPU  time.  We  shall  return  to 
this  question  in  section  12. 
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EXPP143M  We  got 


-*'-4.  <“(  ..  i  oLL'i  L<  4 


/•  - 


z i?.s:.5j?ccic  !•: •2G7crr:i 


. .  .;  9  ..  v*  — 

o » 


i »  *  :  •  t  C*  = 

10.57130400  1C  .322S2S32  8.277025G41 

~o.ro  = 

125  24 
••  ••>  #•>  _ 

IS  ,54005? 24  24.5S1P3554  1.275f-3CC7C 

ro.ro  = 
ic  so 

«.  »P-  iC  ~ 

3.S1S217S  4 .05413  02  G  15.02570473 

rc.ro  = 


57  114 


FLC”  Q~JrCBC? 


l 


:,ocAzzcn  ? 

it 

45  45 
CpFZCS  ? 

ALLQBJVCSSt 1 5  5  3 

T)  >•  /■»  :*/  7VTn 

4  Vi/C-  w  v  -  f 

M'svnn  o  or  1 


G: 


L0C//J1Q::  ? 

G: 

55  75 

o:\-cct  ? 

D: 


^  iiltC Be.'  ijCT S  [•  ^ 

PL  ACS  Q3J0C2C? 

Aucunn  o  oj?  1 


l.  : 


and 


RFCOGUIZE  EXPD1W! 

ALGGRITKU  DECIDES  C  RE  DID  I  LI  Cl  OF  VIPCTESSIS: 
OBJECT  VO.  ft 
AT  LOCATION  ?.7  84 
TO  BE  -  43 

ALGO RIT all  DECIDES  CRVDIEII.ITE  OF  VIPCTEESISi 
OBJECT  VO.  3 
AT  LOCATIOV  CS  34 
TO  BE  =  42 

ALGORITIVI  DECIDES  CP.EPIBILITT  07  1170:1  VI' SIS : 
OBJECT  VO.  2 
AT  ZCC AVICI:  SI  35 
TO  BE  =  35 

ALGO  RIT  Hi!  DECIDES  CP.EDIBILITE  07  VTPOTEESIS: 
OBJECT  VO.  5 
.I:?  LOCATION  34  3  0 
=  2  £ 

ALGO  RIT  Ell  DECIDES  CP.EDIBILITE  OF  VIPQTEBSISi 
OBJECT  no.  0 
AT  LOCATION  35  7 C 
TO  BE  =  24 

ALGORITEi:  DECIDES  CF.EDIBILITE  07  VEPOTirSISi 
OBJECT  VO.  1 
AT  LOCATIOV  Sft  3S 
TO  BE  =  13 


RESULT  CF  DECISIOV  FUVCTIOV 
OBJECT  VO.  4 
AT  LOCATIOV  37  C4 
EITV  CEE  DIB I LITE  43 


OBJECT  VC.  1 
AT  LOCATIOV  04  0$ 
RITE  CREDI2ILITI  13 


which  looks  correct  but  is  not.  Indeed,  the  object  recognized  as  no.  1  has  its 
center  located  at  the  point  94,8?  instead  of  at  45,45.  It  is  just  luck  that  the 
algorithm  claims  to  have  recognized  no.  1. 
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7.4.  The  experiments  carried  out  so  far  indicate  that  for  the  given  mode! 
the  algorithm 

(i)  performs  well  as  a  detector/recognizer  when  there  is  little  or  no 
obscuration 

(ii)  performs  less  well  as  a  recognizer  when  obscuration  occurs,  but  still 
fairly  well  as  a  detector. 

In  the  latter  case  lowering  the  k-value  to  85%  leads  to  noticeable  better 


performance. 


7  Z<-S1  BOT *  S2iKliB2iMliN2iVARUVAR2 
Cl]  ttCRITBRTOr  FOR  SHALL  IN -V ART ARCS 
C2]  nAND  ALSO  LARGE  OriT-VARTA"CR 

[3]  jri+psi 

[4]  N2+pS2 

C53  Nl+(+/SD*Nl 
C  R]  N2+l+/S2)*N2 
[7]  VARl+(+/(Sl-Nl)*2)*Nl 

C  8]  VAR2+1  ♦/  ( S2-N2  )*2)*N2 
C93  Z+( VAR1&C0NST)*VAR2 

V 

V  Z+C RANGE  FIBr.DiMSA"StVARSiT 

Cl]  r+o 

C  2]  MBANS+FISr.D 
C3]  VARS+FIBr.D*  2 

C 4 ]  £OOP:^»5^il»5+^CriO]<>ro]  BJlTilWlELD 

C 5 ]  KjU?5«*-fttJrS+WCTjO]*ro]  NJlTilWFIEr.D*2 

C  63  T+T+l 

C  7  3  +(T<8)/LOOP 

C  8]  Z+( VARS- IHBA*S*2 ) ♦ 9 ) <12 *TCONST 

V 

V  Z+-FBW  CLEAN  XiTlNNEIGB 

Cl]  ^REMOVES  POINTS  WITH  FEN  NEIGHBORS  FROH 
C 23  tBINARI  IMAGE  X 
C  3]  T+O 

C  43  NNRIGH+(pX)pO 

C 53  LOOPiNNBIGR+SNEIGH+NJiTiOWOl  NJtTilW 

cr]  r+r+i 

C  7  3  +(T<8)/LOOP 

C  83  Z+IANNBIGB>FEW 

V 


V  COLLECT  IT iCi INTER  TOR 

Cl]  nCOLLECTS  ALL  NOBJECT  OBJECTTYPES  INTO  3 -DTM  ARRAY 
C 2]  A CALLED  ALLOBJECTS 

C 3 ]  fiBACB  OBJECT  REPRESENTED  AS  L*L  DTGITAL  BINARY  PICTURE 
C  4]  T*  0 

C  5 ]  ALLOBJBCTS+l NOBJECT S »L»L)pO 

Cfi]  LOOPtC+i( 'OBJECT') ,1T 
C  7  3  C+C*LSCALB 
C  8]  Cl {0]+CC ; 0]+0 .51 
C  9]  Cl ;1]«-£C ;1]+*19 
CIO]  INSTDB 

C 11 3  ALLOBJECTSIThI+INTERTOR 
C 123  T+T+l 

C 1 3  3  +{T<NOBJECTS) / LOOP 

V 
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7  COORDS+COORD  B00LEiR0VSiR0VNUMSiC0T.SiC0LNUMSiLliL2 
[13  ^TRANSFORMS  LlxL2  BOOLE A "  MATRTX  BOOTH  INTO  2-COLUMN  HATRTX  COORDl 
C23  hCORTAINIMG  X.l -COORDINATES 
[33  Ll+lpBOOr.K)tOl 
[43  L2+(pB00!E)tH 

[53  NROVS**/*t BOOLE 

[63  COORDS+(NROVS,2)pO 
[73  ROVS+( \L1) • ,*L2pl 
[83  ROVNUMS+ROVS*  BOOT.g 

[93  COORDSt  i03+(  •  BOO Lg )  /  »ROVNUMS 

[103  COLS+iLlpl ) • ,*\L2 
[111  COLNUMS+COLS*BOOLR 
[123  COORDSt  1 l3«-(  ,B00T.g )/ tCOLNUMS 
V 

7  Z«-51  CORR  52 
[13  ft COMPUTES  CORRELATION 
[23  2«-(+/+/51x52)++/+/(~51>x~52 

7 

7  Z+K  CUTOFF  FIELD \NZ  jfll  ?Q2  \ C3 
[13  ft COMPUTES  THRESHOLD  VALUE  FOR  FTELJ) 

[23  2+.FTBLD 
[33  Z*Z[AZ3 
[43  NZ*pZ 
[53  ai^Z[L0.25x5Z3 

Lfi3  «2«-Z[L0.5x*Z3 
[73  Q3^Z[L0.75x5Z3 

[83  Z«-fl2+*x(fi3-fll)*2 

7 

7  DISPLAY  ZiMINiMAXiD 
[13  MAX+M/Z 
[23  MIN+l/l/Z 
[33  D+MAX-MIN 

[43  $[o3*(*  .•o*0»)r+/((z-tfr*)*5)*.i  o  0.2  0.4  0.6  o.83 

7 

•  7  Z+BLDISTillJ 

[13  ^COMPUTES  BAMMING  distance  MATRTX  Z 
[23  *FOR  ALL  SBAPK  ELEMENTS 
[33  Z*{2pNSLICNS)pO 
[43  I+l+S+O 

[53  LOOP  lZtIUl*Zt  Jill**/*/ \SLICNStIi ll-SLICKStJi :3 
[63  1*1*1 

[73  *(I<NSLICRS) / LOOP 
[83  I+1+J+J+ 1 

[93  +(J<NSLIC*S-1)/LOOP 

7 
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V  E  ST  GENS  FIET,D;TiTENP 

[13  ^ESTIMATES  GENERATORS  FROM  DATA-FTRT.D 
[23  T+Q 

[33  RESULT ♦  0  3  pO 

[43  A RESULT  EAS  AS  ROWS  U»V.T-VALU*S 

[53  LOO TBMP+SLICRSt T i i 3 

[63  LTEMPr+(pTKMP)LOl 

[73  LTEMPI+{pTRMP)lM 

[83  VIEW  FIET.D 

[93  SEARCH  CRITERION 

[103  RESULT+RRSULT .[03  T, COORDS 

[113  T+T+l 

[123  T<  (  p  GENERATORS )  [  0  3  )  /  LCC .* 

7 

V  Z+RLIST  EVIDENCE  TLIST 

[13  A COMPUTES  DEGREE  OF  EVIDENCE  FOR  BIPOTNBSTS  ( OBJECT ) 

[23  aSPECIFIED  B1  shapet.eements\locations  IN  3 -COLUMN  MATRIX  HLIST 
[33  ASUPPORTED  bi  z-column  matrtx  tlist  of  test  results 
[43  aGLOBAL  SCALAR  WEIGHT  EXPRESSES  IMPORTANCE  OF  DISTANCE 
[53  aBETWEEN  SHAPR  ELEMENTS  AS  COMPARED  TO  EUCLIDEAN  DISTANCE 
[63  aBETWEEN  LOCATIONS 
[  7  3  Z+DISTE T. [ HLISTl ;  0  3  s  riI52,[ ;  0  3  3 

[83  Z‘—(Z*WBIGHT)++/tlUO  12  1  kBLISTLi  1  23  •  ,-TLISTt  i  1  23)*2 

V 

7  Z+FINDGENSiT i ALLOBJECT SI 

[13  aCOMPUTES  GENERATORS  ( SHAPR  ELEMENTS)  FROM  OBJECTS  STORED 

[23  AIN  ARRAY  WITH  GLOBAL  NAME  ALLOBJECTS 

[33  ARESULT  STORED  IN  3-DTM  ARRAY  Z 

[43  Z+(OtLTEMPX.LTEMPY)QO 

[53  T+0 

[63  ALLOBJECT Sl+( ipALLOBJECTS)+lO , ( 2 xLTEMPT) . ( 2xLTEMPI) ) ) pO 

[73  ALLOBJECT S\i iLTEMPX+\LiLTEMPY+\L]+ALLOBJECTS 

[83  LOOP ilMAGB+ALLOBJBCTSlt Till 

[93  Z«*Z.[03  DIST  SELECT  IMAGE 

[103  T+T+l 

[113  +{T<NOBJECTS) / LOOP  *’ 

[123  ff£+(pZ)[03 

7 

7  Z*S1  FTSRER  S2iNllN2iMliM2iVARllVAR2 
[ 1 3  aCOMPUTES  FISHER  TYPE  CRITEION  FOR  VARIANCES 
[23  AOF  THE  TWO  SAMPLES  SI  AND  S2 
[33  J7i«-p51 

[43  N2+pS2 
[53  Ml+(+/Sl)*Nl 
[63  M2+{+/S2)*N2 

[73  VARl+{+/(Sl-Ml)*2)*Nl 

[83  VAR2+{+/(S2-M2)*2)*N2 

[93  Z«*< -(.MVAR1+0,  0001) -9VAR2+0. 0001  )*U*ND**B2)  *0.5 

7 
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7  Z+FORMLIST  BIPiT 

Cl]  pFORMS  LISTS  BIPLIST. ETC  FOR  BIPCTNESTS  SO.  BIP 
C2]  NT+lpTRSTSEDlOl 

[3]  TLIST+(NTt3)pO 

[4]  TLISTtiOl+TESTSBL 

C  5]  TLISTLi  1  23 +TESTSLOC 
C 6 3  i'NB+(pBYPEL' AyBYP) . * ) T03  * 

[73  BLIST+(NBt3) pO 

[83  x'BLISTtiOl+BIPEL'  AyBYP) 

[93  x'BLISTl il  21+BYPLOC' tfBYP 
V 

7  BUST  FU  LITE  ST  T LI ST  ill J  iNBlTLISTl 
[13  tCARRTES  OUT  ALL  TESTS  FOR  GIVEN  LISTS 
[23  ^TRYING  TO  MAT OB  RELATIVE  POSTTIOSS 
[33  I+J+O 
[43  NB+(,pBIIST)ZO 3 
[53  ^(pTLISDCO] 

[6]  NAGREEMAX+Q 

[7]  KEEPMAX*\NT 

[83  LOOPiOFFSET+BLISTlIi  1  2l-TLISTZJi  1  2] 

[93  TLI ST1+TLI ST 

[10]  TLISTlLl  1  23 +TLISTh  1  2l+(NTpl)».xOFFSET 
[113  KEEP+BLIST  MATCB  TLIST1 

[12]  -*(  11  AGREEMENT  SUN  AGREEMAX)  f  LO0P2 

[13]  KEEPMAX+KEEP 

Cl 4]  NAGREEMAX+N AGREEMENTS 
Cl 5]  L00P2  : J+X+l 
[161  -*-(I<NB)  /  LOOP 

[171  I-*-  0 

[18]  J+J+ 1 

[19]  +U<NT)/LOOP 
7 

7  GENBYPLISTS 1T1S 1OBJECT1 SUP iBAMMING ; BEST 

[1]  ft COMPUTES  LIST  CALLED  BYPET,  OF  SB  APE  ELEMENTS  FOR  EACB  OBJECT 

[2]  *AND  LIST  CALLED  BYPLOC  OF  CENTER  COORDINATES  OF  FITTED  SB  APE  ELEMENTS 

[3]  n ASSUMES  AVAILABLE 13-DTM  ARRAY  SLICES  OP 

[4]  nSBAPE  ELEMENTS 

[5]  NSLICES+(pSLICRS)iOl 

[6]  T+0 

[73  OBJECT+U+2*LTEMPX.LTEMPI)pO 

[83  LOOPliOBJBCTZLTBMPT+xLiLTBMPY+\Ll+ALLnBJECTSiTi ;] 

[93  *NOW  COMPUTE  LIST  OF  SUEPICTURES  ALONG  BOUNDARY  OF  OBJECT 

[10]  ft SEPARATED  BY  DISTANCE  CALLED  DISTNYP 

[11]  SUB+D T STRIP  SELECT  OBJECT 

[12]  xi'BYPLOC' ,yT) .'^CENTERS' 

[13]  Sf 0 

[14]  ±( 'BYPEL ' *vT) • '+NBpO ' 

[15]  LOOP 2 1  BAMMING**/* / | SLICES - ( NSLICESp 1 ) • . xSUBZ S ; : ] 

[161  BEST+BAMMING 1 1/ BAMMING 

[171  l( 'BYPEL' .IT) .'ISl+BEST' 

[18]  S+S*l 

[19]  +(S<NB)/LOOP 2 

[20]  T*T*1 

[21]  +(T<NOBJECTS)/LOOP1 
7 


7  Z+GBBOBJECT  BPOIBTSiT 

[1]  tGBBBRATBS  POLIGOB  WITH  BPOTJtTS  VERTICES 
C2]  Z+(BP0IBTS»2)p0 
C3]  * X-COORDIBATES ' 

C4]  ZC;0]«-0 

[5]  * I -COORDIBATES * 

[6]  ZC  il]«-0 

V 

V  RARGE+GBBSC BBS  BRILLS  ;X  •,  ABSiLOC  ATIOB  iOBJECT 
Cl]  nGEBERATES  SCBBBRI  WITH  BRILLS  BILLS , 

C  2 ]  *SKT.  AND  OBJECTS 
C  3 ]  Z+GEBTERRAIN  BRILLS 

C4]  Z+ZSCALBxZ 

c 5 3  zC;Ui-LSJri)+tz;sJur3«-5Xi  - 

C63  nZSCALE  IS  RBIGRT  SCALE 
C7]  Z+Z+WBITE  SH ALLSCALE 
C  8]  X«-0 

C9]  RANGE+UX.  LX)  plOOO 

CIO]  LOOPliRANGBlXil+STGHri  ZCX;] 

Cll]  X+X+l 
C 12]  MX<LX)/LOOPl 

Cl3l  RABGE+RABGB+ L 0 . 5  +WRITE  BACKGROUBDERROR 
C 1 4 ]  LOOP2i'PLACB  OBJECTS?' 

C 1 5 ]  » ANSWER  0  OR  1' 

C 1 6 1  ANS+n 

C171  +(ANS=0)/ LOOPS 

Cl 83  » LOCATIOB  ?' 

Cl 9]  LOCATIOB* U 
C 20 ]  'OBJECT  ?' 

C  213  OBJECT+Q 
C  22 3  LOCATIOB  PLACE  OBJECT 
C  23  3  +LO0P2 

C  24]  LOOPS :RABGB+RANGE+10 .S+WRITB  OBJECTERROR 

V 
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V  TERR AIN+GENTERR AIN  NR TLLS\T\A iBiC tXSlYSlXO {70 
Cl]  ^GENERATES  BACKGROUND  OF  BILLI  LANDSCAPE 

C2]  aWITB  NR ILLS  BILLS 

C 3]  nSHAPE  OF  BILL  CONTROLLED  BI  A'S  AND  B'S 

C4]  nBEIGBT  OF  BILLS  CONTROLLED  Bl  C'S 

C5]  ft GLOBAL  VARIABLE  POWER  CONTROLS  POWER  LAW 

[6]  ft DISTRIBUTION  FOR  BILL  BEIGBTSiNEGATIVB  VALUES  GIVE  PARETO 

t 73  ft DISTRIBUTIONS 

E  83  T-H) 

C  93  TERRAIN+(,  LX •LY)pO 

CIO]  XS+\LX 
Cll]  1S+\L1 

C12]  LO0PiA+AMIN+(AMAX-AMIN)xlE~6*?10Q0Q0Q00 
C13]  B+BMIN+(BMAX-BMIN)xiE~6x?10QQ0000Q 
Cl4]  C+CMIN+(CMAX-CMIN)x(.lB~  8x?100000000)  *P0WER 
Cl5]  M.B.C  =  '  ....  ^  ?  ' 

Cl6l  A,B*C 
C171  X0+7LX 

Cl  8]  YO+TLY  * 

C19]  'lO.JTO  •  /  - 

C20]  xo.ro „ 

C  21  ]  xO 

C  22 ]  TERRAIN+TERRAIN+C*!* ( ( ( (XS-XO ) *A ) *2 ) • .  +  ( ( TS-IO HB)  * 2 ) *0 . 5 
C23]  r«-r+i 

C24]  -*-{T<NBILLS)  /  LOOP 

V 


Cl] 
C2] 
C3] 
C43 
C  5] 
Cfi] 

C  73 
C  8] 

C  9] 
CIO] 


7  Z+IBOUNDARY  IMAGE iTlOUT 
ft COMPUTES  INNER  BOUNDARY  OF  SET  IMAGE 

1N  TERMS  0F  TW0  CnT'mtt  MATRIX  J 
ABOUND ARY  OF  MATRTX  IMAGE  MUST  BE  FREE  OF  1*5 

NJ+  8  2  p  0  ”1  1  "1  j,  o  1  1  0  1  “1  1  **i  o  “i 

0UT+(pIMAGE)p0 

T+  0 

LOOP:OUT+OUTv~BJtTiOl$l03  NJlTillblMAGB 
T+T+ 1 

+{T<(pNJ)lOl)/LOOP 

Z+IMAGBaQVT 
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V  INSIDE iV iClil iZiX iHXiLKFTiRIGBTilN 
Cl]  ft COMPUTES  DIGITAL  PICTURE  OP  POINTS  IN 
C  23  *LxL- LATTICE  IN STDS  POLIGON 

[3]  ft DESCRIBED  BX  Lx 2  MATRIX  C 
C  4]  V+(\L)*L 

[5]  5l«-(l$C0]  C)-C 

C6]  INTERIOR+U.L)  pO 

[7]  -*-<(15'"8>|5ir  jl])A0sl \LxCl  ill) /VARNTNG 

[8]  1+ 0 

C 93  LOOPliZ+a-ClilDtCll  jl]+0*5lC  ill 
CIO]  X+Cl  ;0]+Zx£iC  ;0] 

c ii]  zi+z+i 

n  12]  X«*(  ( 0*£lC  ;l])A(Zlii)A(ZlS2)A(Zl<2)v(Zl=2)A0>Cir  ;l]xl<(>Co]  ClC  ;1]  )/X 

C 13  3  WCU] 

C 14]  NX+pX 
C 1 5 ]  +(0=NX)/L00P2 

C 161  LEFT+XL2xxNX*2l 
C 1 7  3  RIGHT+Xtl+2x\NX*2l 
C 1 83  IN+(\/ /  .ZLEFT) .&RTGBT) /V 
C 19]  INTERIORILxINiLxXl+l 
C 20]  L00P2:I+I+*L 
C  21]  +(I<1)/LOOP1 

C  223  -*-0 

C 233  WARNINGi'DATA  NOT  WELL  CONDITIONED  FOR  ALGORTiNMl  • 

V 

7  Z«-51  KOLMOGOROV  S2iNl;N2iZSiFliF2 

Cl]  ft COMPUTES  KOLMOGOROV -SMIRNOV 

C 2]  ^STATISTIC  ( STANDARDIZED )  FOR  SAMPLES  SI  AND  52 

C  3]  JI7l4-p51 

C  4]  N2-*-pS2 

C  5]  Z5+51.52 

C  63  ZS*-ZSUZS1 

C  73  Fl-(+/ZS».kSl)*Nl 

C  8]  F2«-(+/Z5«.St52)*52 

[9]  Z«-(  17  \Fl-F2)x(NlxR2*Nl+N2)  *0.5 

V 
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7  Z+K  LEBESGUE  SLICKSiTiNSTNBALL iSiMAXiCLOSE 
[l3  ft ESTIMATES  LKBSSGUK  SET  BI  CBOOSTKG  K 
[23  aBALLS  OF  RADIUS=RADIUS  WIT*  BIGBKST  DEBSTTr 
[33  Z«*  (  0  »  LTBMPX  •  LTEMPI )  p  0 

[43  r+o 

[53  L00Pli+{0=(t>SLICKS)l0l)/EBD 
[63  S+0 

[73  BSrBBALL+(pSLICKS)[OlpO 

[83  LOOP2iNSINBALLiS3*SLICEStSa3  NTNBALL  SLICKS 
[93  S+S+l 

[103  +(S<(pSLICKS)lQ3 )IL00P2 
[113  MAX+NSINBALL\[ /NSTNBALL 
[123  Z-«-Z.[03  SLICKSLNAX Ji3 

[13  3  CLOSE-RADIUS**/ +/ \  SLICE  S-(. (pSLICKS)Z03pl) •  .*SLICKSlMAX i  ;3 

[143  SLICRS+(~CLOSB) /l03  SLICKS 

[153  T+T+l 

[161  +{T<K)/L00P1 

[171  aNOW  DELETE  EXTREME  GERBRATOR  ESTIMATORS 
[183  END :DR0P*(0.3 xLTEMPXxLTEMPX )< I (0.5 xLTEMPXxLTEMPI )-+/+/ Z 
[193  Z+(~DR0P)/Z03  Z 

[203  NSLICRS+(pZ)Z03 
V 


V  KEEP+HIPLIST  MATCB  TLIST  i AGREEMENTS ; NROVS ; NCO T.S 
[13  aTRIES  TO  MATCB  SUBSET  OF  TEST  RESULTS  IK  3 -COLUMN 
[23  aMATRTX  TLIST  VITK  SUBSET  OF  SB  APR  ELEMENTS/ LOCATIONS 
[33  ft 

[43  aRESULT  Z  IS  VECTOR  OF  SUBSCRIPTS  IK  TLIST  THAT  SHOULD  BE 

[53  ADROPPED  FROM  TLIST  AFTER  MATCHING 

[63  AGREEMENT S+BIPLI ST  EVIDENCE  TLIST 

[73  NR0VS*( pAGREEMENTS)l 0  3 

[83  NCOLS+i p AGREEMENTS ) [ 1 3 

[93  KEEP+\NC0LS 

[103  MAX* r/[03  AGREEMENTS 

[113  AGREBMENTS+(AGRBEMBNTS=(NROVSpl )  •  .xMAX) *AGREEMENTS>AGREELEVEL 

[123  N AGREEMENTS**/ v/[03  AGREEMENTS 

[131  *{NAGRBE>N AGREEMENTS)/ 0 

[143  Jf££P«-(~v/[  03  AGREEMENTS)/ xNCOLS 

V 

V  Z«-51  MAXDEV  52 

[13  Z«-((I7.52)-L/.52)*0.0001  +  (I7.51)-L/.51 

V 

7  CBNTER+MAXLOC  FTET.DiB00r.KiU \V 
[13  aCOMPUTES  LOCATION  OF  SOME  (!)  MAXIMUM  OF  FIELD 
[23  CENTER* 2p0 
[33  BOO LE+FIELD=[ /[ /FIELD 

[43  U*{ v/ BOOLE) il 

[53  V+Z.BOOT.BlVi  3)tl 
[63  CENTBRt03+(UxSTEP)+LTEMPX*2 
[73  CENTERll3*(VxSTEP)+LTEMPI*2 
7 
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7  Z+C ENTER  NINBALL  SLICES 

Ci;l  ft3 -DIM  ARRAI  CONTAINS  SLICES  OF  SIZE  LTEMPXxLTEMPJ 
[2]  ft COMPUTES  NUMBER  OF  SLICES  IN  BALL  CENTERED  SLICExCENTER 
[33  ^RADIUS  OF  BALL*GLOBAL  V ART ABLE  RADTUS 
[43  Z++/RADIUS>+/+/ \SLICES”{ZpSLICHS)ZOlpl ) •  ENTER 

7 

7  LOCATION  PLACE  OBJECT 

Cl]  M+RANGEL{(-L*2)  +  (  \L)  +LOCATIONZ01  iZ  (  xD+LOCATIONZlll 

C 23  RANGEZ  r  ( -L*2 )  +  (  \L )  ^LOCATION E 03  { T  ( \L )  +LOCATIONZ 1 3  3«-Af t  ( LOCATIONZ  1  3 

xOBJECT)+lQOOOxl-OBJECT 

7 

7  RECOGNIZE  IMAGE i$iTi LOCATIONS ; N  AGREEMAXS  '.PERM ; LOCLIST iNEWLOC 
t 1 3  ft COMPUTES  CREDIBILITY  OF  LIKE LI  BJPOTHRSES 
[23  *FOR  RANGE  DATA  IMAGE 
[33  T+ 0 

[43  TESTS!  IMAGE 
[53  LOCATIONS 0  2  pO 
[63  NAGRBEMAXS+\0 

[7]  NT*(pTESTSEL)Z 03 

[8]  +{0=NT)/Q 

[93  LOOP: 1  * FORMLIST  ' ,yT 
[103  BLIST  FULLTEST  TLIST 
[ 1 1 3  +(NT=oKEEPMAX)/LO0Pl 
[123  LOST+l~(\NT)eKEEPMAX)/\NT 

[133  LOCATIONS+LOCATIONS,lOia+/lOl  TUSTZLOST ;  1  2])*pL0Sr 

[143  NAGREEMAXS+N AGREEMAXS .NAGREEMAX 

[153  LOOPliT+T+1 

Cl6l  -+(T<N0BJECTS)  /  LOOP 

[173  S+ 0 

[183  PERM+lN AGREEMAXS 

[193  LOOP2 :+( S^oN AGREEMAXS ) / SUMMARY 

[203  'ALGORITHM  DECIDES  CREDIBILITY  OF  BJPOTHRSTS : » 

[213  * OBJECT  NO.  ' \pNAGREEMAXS)lPERMl)ZSl 

[ 223  'AT  LOCATION  '  .yUOCATIONSZPRRMlDZSil 
[233  'TO  BE  *  '  .jINAGREEMAXSZPERMDIS 3 

[24]  lO 

[25]  S+S+l 
[263  +LOOP 2 
[273  SUMMARY : lO 

[283  » RESULT  OF  DECISION  FUNCTION  IS:' 

C2S3  5«*0 

[303  +( S*oN AGRBEMAXS) /Q 

[313  LOCUST-*’  1  2  plOOOOOO 

[323  LOOP 3 :NEWLOC+( LOCATIONSlPERM;! ) IS i 3 

[333  +(MINDIST> L / +/ I LOCLIST - ( ( p  LOCLIST ) [ 0  3  p 1 ) • .xNRWLOC) / LOOP* 

[343  LOCLIST+LOCLIST. [03  NEWLOC 

[353  » OBJECT  NO.  ' .?(( \pNAGREEMAXS)lPERMZ)[Sl 

[361  'AT  LOCATION  ' .fNEWLOC 

[371  'WITH  CREDIBILITY  '  .iZNAGREEMAXSZPRRMDZS'] 

[383  lO 

[393  L00P4:$«*-S+1 
[403  MS<pNAGREEMAXS)/ LOOPS 
7 
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7  REC OGNIZER iTiNT; LOST ; CRED 
Cl]  ^RECOGNITION  ALGORTTNM  FOR  RBCOGNTZINC  OBJECTS 

[2]  nIN  IMAGE  REPRESENTED  BI  GLOBAL  VECTOR  CALLER  TLIST 
C  3  3  T+ 0 

[4]  LOOPil'FORMLIST  » ,iT 
C53  BLIST  FULLTEST  TLIST 
1 63  -*-(o=im/o 

[7]  +(NT*oKBEPMAX)/LO0Pl 

[83  'ALGORITNM  SUGGESTS  BIPOTRESTS :  OBJECT  NO.  'AlT)*'  IN  IMAGE' 

[93  LOST+{~i\BT)cKEEPMAX)/\NT 

CIO]  LOCATIONS  TLISTlLOST j  1  23)*p LOST 

[11]  • VITN  LOCATION  AT  *  LOCATION 

[12]  'VITN  CREDIBILITY  ' .fNAGREEMAX 
C131  tO 

[143  LOOPliT+T+l 
[15]  +(T<NOBJBCTS)/LOOP 
7 

7  SCALBD+LEVELS  SCALE  IMAGE iMIN iMAX 

[1]  nSCALBS  IMAGE  TO  GREY  LEVELS 

[2]  nLBFT  ARGUMENT  =ff0.  OF  GREY  LEVELS 

[3]  IMAGED  IMAGE 

[4]  MIN+l/ 1/ IMAGE 

[5]  MAX+[/T/ IMAGE 

[ fi  3  SCALED+l ( LEVELS- 1 ) x(IMAGB-MTN)*MAX-MIN 

7 

7  Z+SCALE  SCALING  OBJECT 

[1]  ^SCALES  AND  PLACES  OBJECT  IN  L*L  ARRAY 

[2]  C+SCALExOBJBCT 

[3]  0[;O]«-0[;O]+*2 

[4]  INSTDE 

[5]  Z+INTERIOR 

[fi]  Z-M*[0]*Z 

7 

7  Z+DIST  SCREEN  BOUND \C LOSE 

[1]  A SELECTS  SUBSBT  OF  POINTS  FROM  B0UND~2COT,UMN  MATRTX 
[23  aPTS  SEPARATED  BI  DISTANCE  ZDIST 

[3]  Z+  0  2  pO 

[4]  £00P:-*-(O  =  <pP00PP>[O])/n 

[5]  Z+Z.C03  BOUND [Oj] 

[63  CLOSE+DIST**/ I  BOUND- ( ( p  BOUND) [ 0] pi ) • . xBOUNDl 0 i ] 

[7]  BOUND+(~CLOSE)/LOl  BOUND 
[83  +£00P 

7 
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7  SEARCH  FIBr.DiFIEr.DliLXFiLIFiTHRESBOr.DiBOOr.KiZSiTSiZ 
Cl]  * COMPUTES  LIST  COORDS  OF  SEPARATED  MAXIMA  OF  FIELD 
[2]  *MIN  SEPARATION  DISTANCS=NBIGH 
C3]  *C OB ST ANT  K  DECIDES  CUTOFF  LEVEL 
C4]  LXF+{pFIEI.D)iOl 
C53  IIF+(pFIF£l»Cl] 

[6]  COORDS «•  0  2  pO 

C7]  TRRESBOLD+K*L TEMPI x  L TEMPI 

C8]  FIELDl+FIBLD 

C9]  LOOP-.Z+ 2p0 

CIO]  BOOr.E+FIELDl*UT/FIBLDi 

Cll]  ZZQl+{v/B00T.B)\l 

Cl2]  ZCl]+(  •BOOLEtZlOl  s  ] )  tl 

C13]  -(FIELDltZZQl  iZZHZ<TBRESBOr.D)/0 

Cl 4]  COORDS+COORDS *ZOl  Z 

Ci5]  xs+(orzCo]-FFifffl).z;xFi zco i+neigh 

C 1 6 1  IS+iOtZZll-NBIGH) .LYFlZZil+NEIGB 

C171  FJFr.0lCXSCO]  +  iX5[l]-X5CO]{YSCO]  +  irSCl]-ISCO]]«-“loOOOOOOO 
Cl  8]  +LOOP 

V 

V  SEE  IMAGE 

Cl]  <»  Q')C<K0]i»IWi4GF] 

V 

V  SEEGEBS i T ; FRAME 
Cl]  X*-0 

[2]  FRAME+12+LTEMPX. LTEMPY)?'*' 

[3]  LOOP:FRAMEZU\LTEMPXtl+\LTEMPYW  '  0* ) ZMOlbSLICRSZT l  j ] ] 

C4]  1  SHAPE  ELEMENT  BO.  ' .IT 

[5]  FRAME 
C6]  i0 
C7]  T+T+l 

[8]  +{T<NSLICES)/LOOP 
7 

7  Z+DIST  SELECT  IMAGE  ’.BOUNDARY  iNEWBOUNDARY  iTlXVEC iYVEC 
Cl]  * SELECTS  SUEPICTURES  OF  SIZE  LTEMPTxLTEMPY  FROM  IMAGE 
C2]  ft CENTERED  AT  POINTS  ALONG  BOUNDARY  OF  IMAGE 
C  3 ]  ^SEPARATED  BY  DISTANCE  DIST 

C4]  WARNING l SET  IN  IMAGE  MUST  BE  AT  LEAST  LTEMPJ .LTEMPY  FROM 

C5]  nB ORDER  OF  BOOLEAN  MATRTX  IMAGE 

C  6 ]  BOUBDARY+IBO US DARI  IMA GE 

C7]  NEWBOUNDARY+DIST  SCREEN  COORD  BOUNDARY 

[8]  NB^pNEWBOtlNDARDZOl 

C  9]  CENTERS^  NB.  2)p0 

CIO]  Z+{NB.LTEMPX. LTEMPY) pO 

Cll]  XVEC+(-lLTEMPT*2)+\LTBMPX 

C 1 2  ]  IVEC+(-UTEMPY*2)  +  \LTBMPI 

Ci3i  r+o 

C 1 4  ]  LOOP’.ZZTa  l+IMA  GE  C  NEW  BO  UN  D  ARY  [TjO]  +XVEC  i  NEW  BOUND  ARY  ZT  ill +YVEC1 
Cl  5]  CENTERSZT il+NEWBOUNDARYZTih 
C 161  M+l 
C 17 1  +{T<BB) / LOOP 

7 
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7  RBSULT+SELECTALLiTiALLOBJECTSl 
[1]  A ITERATES  FUNCTION  CALLED  SELECT  ON  ALL  OBJECTS 
[23  T+0 

[3]  RESULT+(0 %LTEHPX  %LTEMPI)pO 

[4]  ALLOBJBCTS1+ZNOBJBCTSAL+2*LTBMPX)  tL+2*LTEMPX)pO 

[53  ALLOBJECT Sll iLTEMPX* \LtLTEMPI* \L]+ALLOBJECTS 

[63  LOOPi RESULT+RESULT » [ 0 3  DTST  SELECT  ALLOBJBCTSltTlO 
[73  M+l 

[83  +{T<NOBJECTS) / LOOP 

7 

7  Z+SIGHTl  FTELDi APPEAR iT 
[13  A COMPUTES  RANGE  DATA  FROM  GIVEN  BRIGHT  FIELD 
[23  A ELEVATION  ANGLE  IS  PSI  IN  RADTANS 
[3]  APPRAR+FIELD+l xLY)*ZOPSI 
[43  APPEARS \APPEAR 

[5]  Z+LXpO 
[63  T+l 

[73  LOOPtZZTl+iAPPEARlTlyL/APPRARlxTDxT 
[83  z[r]^z[!P3+z[2,-i]xiiPPPii/?[r]sr/iiPPP>!i?[\r3 
[g]  t+T+1 

[103  +(T<LI) / LOOP 

7 

7  z+sn 

[1]  A GENERATES  BACKGROUND  SKI 
[23  Z+(LX.LSKI)f>DMAX 

7 

7  Z+Sl  STUDENT  S2iNliN2iMUM2iSDl;SD2 
[13  A STUDENT'S  CRITERION  FOR  TWO  SAMPLES  SI  AND  S2 
[23  tfl+p51 

[3]  N2+pS2 

[4]  Ml+(+/Sl)*Nl 

[5]  M2+(+/S2)*N2 

[63  SDl+{  (+/(S1-M1)*2)*JV1)*0.5 
[73  SD2+-(  ( +/  ( S2-M2  )*2)*tf2)*0.5 

[8]  Z+(  I  Af  1  -  2 )  *  0  .0001+((  {SDl*2) *N1  )  +  (SD2*2)  *N2 )  *0  .5 

7 

7  TESTS  IMAGE iNSLICRSiT 

[13  A COMPUTES  VECTOR  TBSTSBL.OF  SB*PR  ELEMENTS 

[2]  A DETECTED  IN  IMAGE .  AND  2-COLUMN  MATRIX  TESTSLOC 
[33  nWITN  THE  COORDINATES  OF  THEIR  CENTERS 

[43  A USES  3 -DIM  ARRAY  SLICES  OF  SELECTED  GENERATORS = 

[53  USB APE  ELEMENTS 
[63  TESTSEL+ 10 

[73  TESTSLOC *■  0  2  pO 
[8]  NSLICES+(pSLICF.S)lQ 3 
[93  T+ 0 

[103  LOOPI iTEMP+SLICESZT ;;3 

[113  VIEW 1  CHANGE  IMAGE 

[123  SEARCH  CRITERION 

[133  -*-(O  =  (p£00/?0S)[O3  ) / LO0R2 

C143  TESTSEL+TESTSEL .  ( ( p  COORDS )  [  0  3  )  p  2* 

[153  TESTSLOC+TESTSLOC. [03  TRANSFUVS  COORDS 

[163  LOOP2:T+T+ 1 

[173  •*(  T<N  SLICES)  t  LOOPi. 
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7  TESTS 1  IMAGE iTiSiBOUNDARIiNBOUNDiBOOr.RiMXiHTiTHRESBOr.D 
Cl]  A COMPUTES  VECTOR  TESTSBL  OF  SB APR  ELEMENTS 
C 23  A DETECTED  IN  IMAGE .  il»Z>  2-C0C  MATRIX  TESTSLOC 
C  3 3  aJ/IXB  TBE  COORDINATES  OF  TBBIP  CENTERS 
[43  A USES  Z-DIM  ARRAI  SLICES  OF  SELECTED  GENERATORS * 

C  5  3  *SBAPE  ELEMENTS 

[6]  A MUCB  REDUCED  SEARCB  EFFORT 

C  7  3  TESTSBL* iO 

[8]  TESTSLOC *  0  2  pO 

C  93  5«-r«-0 

CIO]  IMAGE+FBW  CLEAN  CBANGE  IMAGE 
Cll]  BOUND ARY+COORD  IBOUNDARI~IMAGE 
[12]  MX+-UTEMPX*  2 
C 13]  M1+-ILTBMPI* 2 
Cl4]  TBRESB OLD+K xLTEMPX x  L TEMPI 

C 1 5  ]  BOO  LE*(  (  - MX )  <  BOUNDARY  [  }  0  ]  )  ABOUND  ARY  [  ;  0  ]  <LX+MX 
C 16 1  BOOT.E+BOOLEA ((-«!)< BOIMZMm ;  1  ] )  ABOlMZMflrC  ;  1 1  <£!+#! 

C 1 7 3  BOUNDARY+BOOT.E/iO]  BOUNDARY 
Cl 8]  NBOUND+l  pBOUNDARY)iO'] 

Cl 9]  LOOPliTEMP+Sr.ICRSlTiil 

[20]  MTHRESBOr.D>TEMP  CORR  IMAGElMX+BOUNDARYlSiOli  +  xLTENPI ; 

MY  ABOUND ARY C  5  j 1 ]  +  l LTEMPY ] ) / L00P2 

[21]  TESTSEL+TESTSEI.T 

[22]  TESTSLOC+TESTSLOC, [0]  BOUND ARYiSil 

[23]  L00P2-.S+S+1 

[24]  -*•(  S<N BOUND )  /  LOOPl 

[25]  5«-0 

[26]  T+T+l 

[27]  +(T<N SLICES)/ LOOPl 
V 

7  Z+TRANSFUVS  UVS 

[1]  A TRANSFORMS  UV-COORDINATES  TO  XT* 5 

[2]  Z+(pUVS) pO 

[3]  Zli0'}+l(UVSli0l*STEP)+LTEMPX*2 

[4]  Zi  ;  1  >1  ( UVS  [  ;  1  ]  *STEP )  *  LTEMPY*  2 
7 

7  Z+TURN  MATRIX 

Cl]  A TURNS  MATRIX  FROM  MATRIX  COORDINATES  TO  XX  »S 
[2]  Z-H*[0]&AMri?IX 
7 
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7  VIEW  OBS  iNUMX  iHUMI  iU  ;V  iSANPLEIN  iSAHPLEOftT 
£l3  * COMPUTES  CRITERION  FOR  RAMS  DATA 

£23  hUSBS  CRITERION  DEFINED  BI  • TEST »7 
£33  NUHX+l ( LZ-LTENPI) *STEP 

£43  NVNT+IU1-LTBMPI)*STBP 
£53  CRITERTON+iNUMX.NUMDpO 
£63  U+V+Q 

£73  L00P1 iSAM?LE+OBSl(UxSrBP)+\LTBMPX;(V*STEP)+\LTEMPI} 

£  83  SAMPLBIN+l .TEMP)/ . SAMPLE 

£93  SAMPLEOUT+(~.TENP)/ .SAMPLE 

£103  CRITERTONLUlVZ+iL{  'SAMPLBIN  »)  ATTEST)  .*  SAMPLEOUT' 

£113  IH-ff+1 

£123  +(U<NUMX)/L00P 1 

£133  ff«-0 

£143  K«-F+l 

£153  •*■(  V<NUMI )  /  LOOP! 

V 

7  VIEW1  OBS 

£13  ft COMPUTES  CRITERION  FOR  RANGE  DATA 
£23  *USES  CRITERION  DEFINED  BI  'TEST' 7 
£33  NUNX-ULX-LTEHPX)*STBP 
£43  JMflH  ( LI~LTEMPI)*STEP 

£53  CRITERION+WUMX.NUMDqO 
£63  U+V+ 0 

£  7 3  LO0P1 : SAMPLE+OBSl  ( UxSTBP)+\ LTEMPX >AVxSTEP)  +  \ LTEHPI 3 

£83  CRITBRTONZUlVl+l .TEMP)  CORR, SAMPLE 

£93  •  V+V+ 1 

£103  •*■(  U<NUMX) / LOOP! 

£113  U+Q 
£123  V+V+X 
£133  *►(  V<NUMI)/  LOOPl 

7 

7  Z+WHITE  STGMAiS 

£13  ft COMPUTES  GAUSSTAN  WBTTE  NOISE  FIELD  OF  S.D.  STGMA 
£23  HAND  OF  SIZE  LXxLI 
£33  5«-0 

£43  Z^UX.LDqO 
£53  LOOPtZ+Z+HLX.LDpXOOOOQOOO 
£63  S+S+ 1 
£73  +(S<X2)/L00P 

£83  Z«-SIG/Mx“6+ir*8xZ 
7 
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9.  Instructions  for  Using  Software  Package  for  Scene  and  ATR  Simulation 

0.  Introduction. 

This  software  package,  written  in  APL,  is  intended  for  the  following 

purposes: 

a)  to  simulate  terrain,  placing  of  objects,  and  the  noise  of  sensor 

b)  to  compute  optimal  selection  of  shape  elements  to  characterize  a 

given  ensemble  of  objects:  estimate  a  Lebesgue  set  in  the  space  of 
shape  elements 

c)  to  test  for  presence  of  objects  in  terms  of  their  shape  elements 

d)  to  integrate  the  results  of  the  tests  by  a  parallel  logic  algorithm  for  the 

detection  and  recognition  of  objects  against  clutter. 

1.  SJMULATIQN-QF  PATA 

Choose  size  of  picture  (total  size)  as  LX  by  LY.  For  example  LX«LY-68  or 
128.  This  is  only  limited  by  the  size  of  the  workspace  that  is  available. 

Choose  vertical  dimension  of  shy,  LSKY,  as  upper  part  of  picture.  For 
example,  LSKY  ■  12. 

Choose  height  scale  ZSCALE.  This  is  only  for  convenience:  to  be  able  to 
make  landscape  feature  large  or  small  compared  to  object  size  after  objects  have 
been  defined.  For  example,  start  with  ZSCALE  *  1. 

1.1.  GENERATE  OBJECTS.  First  define,  for  each  object  and  orientation  the 
viewed  object  boundary  by  a  matrix  OBJECTO,  OBJECT1,  OBJECT2,  etc.  with  two 
columns;  x  and  y  values  in  respective  columns.  Here  x  and  y  axes  have 
conventional  orientations  (not  as  in  matrix  coordinates  where  first  coordinate 
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points  downward  and  second  to  the  right).  Call,  for  the  first  object, 

OBJECTO  -  GENOBJECT  NPOINTS 

where  NPOINTS  is  number  of  corners  in  polygonal  boundary.  The  user  will  be 
interrogated  for  the  x,y  values  of  the  corners.  Result  is  the  desired  corner  matrix. 

First,  set  size  LxL  of  object  frame.  Here  L  will  be  smaller  than  LX 
and  LY.  Example:  L»37  or  51.  A  prime  number  is  convenient  since  that 
will  avoid  a  special  condition  when  executing  function  INSIDE  called  by 
GENOBJECT. 

After  all  object  types  have  been  defined,  say  NOBJECTS  of  them,  collect  all 
of  them  into  a  3-dimensional  array  ALLOBJECTS  by  calling,  after  defining 
LSCALE,  relating  coordinates  in  polygonal  boundaries  to  pixel  size  in  LxL  picture 
(for  example  -.75)  the  function 

COLLECT 

Note:  The  number  of  objects  in  a  simulated  scene  can  be  smaller  (some  object 
types  do  not  occur  in  the  scene)  or  larger  (some  object  types  occur  more  than  once 
in  the  scene)  than  NOBJECTS. 

To  display  a  picture  (quickly  and  crudely  on  the  screen)  given  by  a  binary 
matrix  defined  digital  picture  IMAGE  with  the  conventional  orientation  of 
coordinate  axes  called  the  function 

SEE  IMAGE 

Which  was  the  character  □  for  an  inside  point  (>1)  and  a  blank  for  an  outside 
point  (■()).  This  will  give  a  rough  idea  of  how  easy/difficult  it  will  be  to 
discriminate  between  the  objects.  Use  for  example  IMAGE  •-  OBJECTO  etc. 
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Note.  When  we  call  COLLECT,  and  later  on  GENSCENE,  the  function  INSIDE  is 
invoked.  Be  sure  to  select  x-coordinates  that  are  not  multiples  of  1/L;  otherwise  a 
warning  statement  is  printed  to  indicate  special  condition  not  accepted  by  the 
function  inside. 

\2.  GENERATE  BACKGROUND.  The  simulated  landscape  will  have  smooth 
large  scale  features  but  also  more  chaotic  small  scale  features. 

The  smaller  scale  is  controlled  by  a  parameter  SMALLSCALE,  for  example 

-.1. 

We  now  call  the  function  GENSCENE  in  the  format 
RANGE  -  GENSCENE  NHILLS 

where  the  parameter  NHILLS  controls  the  number  of  hills  in  the  large  scale 
features. 

This  function  also  needs  the  parameter  BACKGROUNDERROR  =  standard 
deviation  of  the  measurement  errors  of  the  range  sensor,  for  example  =10. 

The  function  interrogates  the  user  about  placements  of  objects  and  their 
location  as  a  2-vecf:>r  with  (x,y)  coordinates.  Respond  to  question  about  which 
object  by  inputting  digital  representation  of  object,  for  example  type  5: 

ALLOBJECTS[5;;] 

It  calls  another  function  GENTERRAIN  that  interrogates  the  user  about 
location  of  the  objects.  This  function  needs  the  following  global  variables,  with 
suggested  values, 

AMIN-4  AMAX-50 
BMIN-4  BMAX-50 


CMIN-3  CMAX-10  or  5. 
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During  execution  the  simulated  values  of  A,B,C  as  well  as  XO,XY  are  printed  for 
each  hill.  The  C-value  determines  the  height  of  a  hill,  A  and  B  the  half  axes  of 
their  elliptical  contours,  and  XO,YO  their  location,  all  expressed  in  pixels  as 
units. 

The  resulting  LX,LY  matrix  RANGE  contains  the  measured  distances.  They 
are  obtained  using  the  function  SIGHT1,  which  needs  the  depression  angle  PSI  (in 
radians),  for  example  .2. 

1.3.  UTILITIES. 

1.3.1.  To  get  a  crude  idea  of  a  range  field  RANGE  execute 

DISPLAY  RANGE 

The  resulting  character  matrix  uses  the  symbols  'blank  •  0  o  □'  for  increasing 
values  of  the  range. 

1.3.2.  In  the  IBM-CMS  environment,  to  make  the  APL  matrix  MATRIX  into 
CMS  file  called  MATRIX  IMG 

do 

)CLEAR 
)COPY  IOFNS 
)COPY  WS  MATRIX 

’MATRIX  DATA’  PUT  (20  FORMAT  MATRIX) 

)OFF 

1.3.3.  To  rearrange  matrix  IMAGE  for  viewing  it  with  conventional 
orientation  of  axis  do 

NEWIMAGE  -  TURN  IMAGE 
and  to  scale  it  to  NLEVELS  grey  levels 
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NEWIMAGE  -  NLEVELS  NEWIMAGE 
for  example  with  NLEVELS  •*  64. 

1.3.4.  To  form  the  3-column  matrix  HL1ST  needed  later,  and  whose  first 
column  is  the  shape  element  list  of  hypothesis  no.  T,  and  whose  two  remaining 
columns  are  (x,y)  locations  of  the  shape  elements,  execute 

FORMLIST  T 

At  the  same  time  it  computes  the  corresponding  TLIST  from  the  image.  It 
results  in  the  global  matrices  HLIST  and  TLIST. 

1.3.5.  To  compute  the  global  matrix  ELDIST  of  Hamming  distance 
between  shape  elements  do 

DISTEL  -  ELDIST 

where  ELDIST  will  be  a  NGxNG  matrix  of  mutual  distances;  this  is  done  after 
FINDGENS,  LEBESGUE  have  been  executed. 

Use  the  function  SEEGENS  to  see  generators  (shape  elements)  obtained  from 
FINDGENS  and  LEBESGUE. 

2.  SELECTING  GENERATORS 

2.1.  SHAPE  ELEMENTS.  Generators  will  have  to  be  chosen  as  shape  elements: 
neighborhoods  of  objects  view  through  windows  of  size  LTEMPX.LTEMPY 
centered  at  points  of  the  boundaries  of  objects.  For  example 
LTEMP-LTEMP  Y-9. 

All  the  shape  elements  will  first  be  computed  and  stored  in  a  3-dimensional 
airay  ELEMENTS.  This  is  done  by  executing  the  function  FINDGENS  which 
needs  the  global  variable  DIST  which  separates  points  along  boundary  of  objects, 
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for  example  DIST-3.  Execute  the  function  as  described  below 

FINDGENS 

Note.  It  is  necessary  that  object  boundaries  obtained  from  OBJECTS  be  at  least 
distance  LTEMPX,LTEMPY  away  from  boundary  of  LxL  matrices  in  OBJECTS. 

It  is  a  good  idea  to  display  at  least  some  of  the  shape  elements,  using  the 
utility  function  SEE  or  SEEGENS. 

So  that,  after  executing 

COLLECT, 

which  creates  a  3-dimensional  array  called  ALLOBJECTS,  do 

SLICES  -  FINDGENS, 

which  selects  shape  elements  centered  at  boundaries  of  all  the  objects. 

2.2.  THE  LEBESGUE  SET  ESTIMATION.  To  estimate  Lebesgue  set  in  space  of 
all  LxL  shape  elements  we  execute 

SLICES  -  K  LEBESGUE  SLICES 

where  K  is  a  number  of  generators,  NG,  wanted  and  a  global  variable  RADIUS 
designs  the  radius  of  the  balls  used  to  cover  the  Lebesgue  set.  RADIUS  should 
be  fairly  small,  say  5-15,  the  local  variable  K  around  20.  (there  is  also  a 
global  K!). 

Execute  GENHYPLISTS  to  form  hypothesis  lists  HYPELO,  HYPLOCO, 
HYPEL1,  etc. 


3.  RECOGNITION  OF  OBJECTS 

3.1.  TEST  LIST.  To  get  the  two  lists  resulting  from  the  tests  on  the  matrix 
RANGE  we  execute 
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TESTS  RANGE 

This  computes  a  list  (vector)  of  shape  elements  detected  in  RANGE  and  a  list 
(matrix  with  two  columns)  of  the  corresponding  coordinates  for  the  centers  of 
these  shape  elements. 

The  driver  TESTS  calls  the  following  functions: 

a)  VIEW  IMAGE 

which  carries  out  a  test  (done  by  the  function  named  TEST)  for  a  particular  shape 
element.  Then  looping  over  all  the  generators  in  the  3xLTEMPXxLTEMPY  array. 
It  results  in  each  time  in  a  matrix  CRITERION 

b)  SEARCH  CRITERION 

which  computes  local  maxima  in  CRITERION  separated  by  a  lj-distance  DIST 

c)  IBOUNDARY  (to  find  boundary  of  a  digital  imge) 

d)  SCREEN  (to  select  boundary  points  separated  by  distance  DIST) 

e)  COORDS  (to  transform  to  pixel  coordinates) 

f)  TRANSFUVS  (to  transform  n,v  coordinates  to  x,y’s) 
all  of  which  are  auxiliaries. 

g)  CUTOFF,  use  K«6  or  smaller. 

For  TEST  the  user  can  select  one  of 

'  STUDENT  (computing  standardized  student  t-test) 

FISHER  (for-Fisher’s  z-text) 

»  KOLMOGOROV  (for  Kolmogorov  criterion) 

or  he  can  substitute  a  test  criterion  of  his  own. 

A  global  variable  STEP  controls  how  crude  the  search  should  be,  perhaps  4 


or  8. 
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3.2.  Now  wc  can  execute  the  driver 

RECOGNIZER 

It  calls  the  following  functions 

a)  EVIDENCE  computes  degree  of  evidence  for  a  hypothesis  specified  by 
HLIST  on  basis  of  data  in  TLIST.  It  results  in  a  matrix  AGREEMENTS. 

b)  MATCH  which  matches  a  HLIST  against  a  TLIST.  The  global  vector 
KEEP  is  the  set  of  shape  elements  tested  that  should  be  kept  after  discarding  the 
significant  ones  relative  to  the  current  hypothesis. 

The  function  RECOGNIZER  types  out  objects  recognized  in  the  observed 
image. 

3.3.  An  improved  version  of  the  above  is  the  driver  in  the  format 

RECOGNIZE  IMAGE 

which  calls  the  main  functions  TESTSI  and  FULLTEST. 

If  no  object  is  detected  in  IMAGE  nothing  is  printed.  In  the  opposite 
case  the  credibility  of  each  object  type  is  evaluated  and  printed  starting  with 
the  most  credible  hypotheses. 

The  scene  can  contain  several  objects,  but,  at  present,  not  more  than  one  of 
each  type.  This  can  be  generalized  by  using  the  vector  KEEP  and  looping 
through  TLIST  after  the  first  run  modified  by  dropping  all  its  rows  except  the 
ones  labelled  in  KEEP. 


9 


12 


4.  GLOBAL  VARIABLES  \ND  THEIR  MEANINGS 


name 

AGREELEVEL 


mean  ins  typical  values 

threshold  value  used  in  accepting  -10*  -5 

tested  shape  element 


ALLOBJECTS  3-dim  array  storing  all  objects  as 

LxL  digital  binary  matrices 

AMAX  largest  half  axis  of  elliptical  hill  20-S0 

contour 


AMIN 

BACKGROUNDERROR 

BMAX 

BMIN 

CENTERS 


see  AMAX,  smallest  value  0-5 

S.D.  of  sensor  error  5-10 

as  in  AMAX  20-50 

as  in  AMAX,  smallest  value  0-5 


centers  of  hills  generated  by  function 
GENTERRAIN 


CMAX 

CMIN 

CONST 

COORDS 

CRITERION 

DIST 


highest  hill  possible  10-20 

as  in  CMAX,  smallest  value  1-5 

1 

2-column  matrix  for  coordinates  of 
maxima  detected  in  function  SEARCH 

matrix  of  test  values 

distance  along  boundary  of  object, 

used  by  functions  SELECT  and 

FINDGENS  2-4 


DISTEL 

DMAX 

(ELEMENTS) 

ERROR 

FIELD 


NGxNG  matrix  of  Hamming  distances 
between  shape  elements 


32 


error  matrix 

LXxLX  matrix  representing  hcightficld 
in  function  SIGHT1 
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namc 


meaning 


typical,  values 


GENERATORS 


3*dim  array  of  shape  demands, 
each  of  size  LTEMPXxLTEMPY 


HLIST 

HYPELO  etc. 

HYPLOCO  etc. 

IMAGE 

INTERIOR 

K 

KEEP 

KEEPMAX 

L 

LSCALE 

LSKY 

LTEMPX 

LTEMPY 

LX 

LY 

MINDIST 


NAGREE 

NAGREEMAX 

NB 


vector  of  hypothesized  shape 
elements  discovered  in  range  data 

shape  element  list  for  respective 
hypotheses 

same  but  2-column  matrix  with 
location  of  shape  elements 

binary  digital  picture  1 

inside  of  given  polgon 

cutoff  cont  6  or  9 

in  respective 
TEST  programs 

vector  of  shape  element  numbers 
to  be  kept  after  testing 

final  vector  KEEP  for  given 
HLIST  and  TLIST 


size  of  object  binary  numbers  37  or  51 

(preferably  prime) 

scale  factor  used  for  transforming  .075 

polygonal  shape  to  fit  LxL  matrix 

height  of  sky  in  scene  0-20 

x-length  of  template  9-11 

y-length  of  ltemplate 

x-side  of  picture  128 

y-side  of  picture  128 

smallest  distance  assumed  between 

hypothetical  locations  of  object 

centers  10 

number  of  agreements  6-8 

largest  number  of  agreements 

found 

number  of  neighbors  in  lattice  8 

topology 
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name 

NEIGH 

NG 

NH 

NOBJECTS 

NROWS 

NSLICES 

NT 

OBJ 

OBJECTERROR 
OBJECTO  etc. 
OFFSET 

POWER 

PSI 

RADIUS 

RANGE 

SAMPLE 

SIGMA 

SLICES 

SMALLSCALE 

STEP 

TEST 

TESTSEL 


mcanina  typical  value 

minimum  separation  between  1*3 

recognized  local  'maxima* 

number  of  generators  10*20 

number  of  hypothesis  in  HLIST 

number  of  object  types  allowed  4*10 

number  of  rows  in  matrix 

temporary  number  of  shape  elements 

number  of  test  values  in  TLIST 

one  of  the  objects 

s.d.  of  signal  from  objects  .5 

objects  in  digital  form 

vector  needed  to  bring  shape  clement 
to  desired  position 

exponent  in  power  law  for  hill  1-3 

height  distribution 

depression  angle  0.1-0.2 

radius  of  balls  in  shape  element  space  4-20 

LXxLY  matrix  with  range  data 
subsort  of  range  data 

1 

temporary  3-array  of  shape  elements 

s.d.  of  small  scale  features  of  scene-heights  0.1 

size  of  step  in  searching  range  data  4-8 

character  vector  of  test  statistics  used  ’FISHER’ 

’KOLMOGOROV’ 

’STUDENT’ 

shape  element  vector  selected  after 
testing  data 
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name 

TESTSLOC 

TLIST 

WEIGHT 


mcifliM 


similar  to  TESTSEL  but  2-column  matrix 
with  locations  of  shape  elements  selected 

vector  of  shape  element  numbers 
selected  after  testing 

weight  for  distance  between  shape 
elements  relative  to  distance  between 
their  location  s 


typical  value 


ZSCALE 


height  scale  factor 


1 
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10.  Objects. 


OBJECT  NO.  Q 


cctc'Gcncrc  cccccrrcn 
rncrccrcra3D 

^rCCCCCnOC±Cna!QKiC!CC.CCDODDCD 

iircccccnccocaxcccoccoDcccDOKXcn 


^LccLCxaicoccaiCDnDCDDGCcaooocrinDO 

:r.a:Dc:^ccccEcnGa:cL,ccccGGcnGDac€ncnc 

GKccnacnxncGODDDncDncc'noGDcncccnn 

CtCLLCCrCCOCDDOClutlDnCDDDDOOtiDCOGD 

:rrj.GGcnmnnriimccrnnnrnnnrir|nrn 


OBJECT  NO.  I 


COGDDCa 

rr,RPnnr.sa 

CnCCGODCCODDO 

GDCODuGOQOGGQ 

CCCDGCCDOCCGD 

DGDGCCODGCCCD 

GuCGGCOGOGOOD 

CGDGODOODDCCa 

GGDDGGODDCDCO 

GGOGDCCGOGDCO 


OBJECT  NO.  2 


CGD 

DCGDQ 

GGQOOGGQG 

DQODDGDODDG 

GOGDGDGGCGOGGGD 

GCDCDGCDGGGGGCDGD 

CCOCOGGDDGODGDCODGDOG 

CGCGCCCGDDDODDODDDDGGGQ 

CGCCGGGGGDDCQGGDGOGCODD 

CCGOGDODDDUDODODODGOODG 

CGCCODGOOCCCGODGGGGCGOG 

CGGCGDDOOGGGOOnOGGGGOOD 

GCrCIGnCCCGraOOOCDDODOOG 

CCGGCGGCCDnOGGOOGDOGOan 

GGCCDGGGGGuOGGGOGCGOOOO 
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KcammsEracctaicc 

ocxDCDDtECDCL'CGcncntrj;! 
acrGccaGODcmcciDocoxc!'. 
GCXXX-GL'DGGDDrUDDXGi! 
CXCCCCDtrXCCDCDGDCJOGn 
XCnGCGCOCDGKXGOStlGCtin 
ZJ  £DXCCC2CCCDDCt!Gi:rC.0D2CnCiCi 
CLxrGGCCDnroGCGtinrDGOcraPGrr'- 
:.r.:Lr:LLcr.::x2DDCGrDXcrcciDi:n 
•--~n-nrTr;:-rnr-rr^‘— 

:::.::c:cc2:tc.mrr  jjt:: 

:c.L..xLi.:-.-:.:::LxcntcG;OTL:cr:r”'T!r 

xxcxr^OTrnrrrTCCcnLGrrrGCPcrr 


XXTGCE 

axrcccc 

XGtraco 


CCGCfiGaj 

:r€GCGDacccx^fTOgararj3mQ0cc 


canicxxcxrincmoXincOTCTffl 

cax^c£^^cax3nixiK]CDriacKxiDnRorin 


ca^CGXXCGcncinoDtJCiCJrionaciciti 
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12.  Conclusions  tnd  continuation.  Although  the  current  version  of  our 
decision  function  performs  fairly  well,  at  least  in  unobscured  situations,  it  has 
some  weaknesses  that  should  be  removed. 

12.1.  It  has  a  number  of  parameters  that  have  to  be  set  before  execution. 
At  least  two  of  them  are  critical:  the  acceptance  percentage  K,  and  the  threshold 
AGREELEVEL.  One  should  also  investigate  by  systematic  experimentation  with 
the  simulator,  if  the  decisions  depend  critically  upon  other  parameters. 

One  should  make  the  algorithm  adaptive  in  the  sense  that  parameters  are 
either  present,  when  this  works  well,  or  estimated  from  the  picture.  The  function 
CUTOFF,  which  was  used  in  the  earlier  version  TEST1  and  RECOGNIZER,  is  an 
example  of  what  sort  of  estimation  procedure  to  use. 

12 2*  The  final  matching  done  by  RECOGNIZE  uses  FULLTEST  that 
employs  a  naive  algorithm,  trying  all  combinations  between  TLIST  and  the 
HLIST’s.  This  can  amount  to  up  to  4000  comparisons.  Since,  at  that  stage  of  the 
computing,  we  have  a  good  idea  of  where  hypothetical  objects  may  be  located,  it 
should  be  enough  for  each  object  to  let  OFFSET  take  on  about  10  x  10  locations. 
For  a  scene  with  two  objects,  and  with  some  false  positives  presented  by  TESTS, 
this  would  amount  to  about  300  values  for  OFFSET.  This  modification  should 
therefore  lead  to  speed  up  by  a  factor  of  10  or  so. 

This  is  imperative  in  realistic  situations,  where  the  number  of  object  shapes 
could  easily  be  500  or  so.  The  matching  will  then  be  done  by  adding  a  hashing 
component  to  RECOGNIZE. 
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12.3.  The  experiments  have,  so  far,  included  only  a  few  cases  with 
obscuration.  This  should  be  continued  systematically  in  order  to  find  more 
precisely  under  what  circumstances  the  decision  function  does  not  work  well. 
Such  knowledge  is  like  to  lead  to  further  improvements. 

12.4.  When  real  pictures  become  available  in  larger  numbers  the  decision 
function  should  be  tested  on  them.  If  the  technology  has  improved  to  such  an 
extent  that  signals  returned  from  the  background  carry  more  information,  this 
should  be  reflected  by  changes  in  line  TESTS[20].  It  may,  at  such  a  stage,  also  be 
meaningful  to  replace  our  flat  shape  elements  by  spatial  shape  elements. 
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App-tndix  I 

Micro-statistical  Analysis  of  Noisv  Images 

1.  The  micro-statistical  approach.  A  major  advantage  of  stochastic  relaxation 
is  its  universality :  it  can  be  applied,  at  least  in  principle,  to  most  pattern  inference 
problems  based  on  Bayesian  models.  Its  use  requires,  however,  a  massive  computing 
effort .  especially  when  the  underlying  connector  graph  o  is  large  and  the  couplings 
expressed  by  the  prior  measure  are  strong. 

We  have  of  course  been  aware  of  this  in  our  group  from  the  very  beginning. 
Since  our  algorithms  are  of  parallel  type  one  can  hope  that  they  are  still  feasible 
in  realistic  situations  given  that  parallel  hardware  is  available.  But  we  have  also 
tried  to  achieve  computational  feasibility  by  analytic  studies  that  have  led  to 
pattern  theoretic  limit  theorems,  most  recently  in  work  by  Chow,  Grenander,  and 
Sethuraman. 

In  this  report  we  shall  suggest  another  analytic  attempt  to  reduce  the 
computing  drastically.  It  is  based  on  the  micro-statistics  of  the  Markov  process 
induced  by  the  prior:  local  statistics  defined  in  small  sets  surrounding  the  sites  in 
the  connector  graph.  The  size  of  these  sets  should  be  much  smaller  than  n,  the 
number  of  sites,  but  considerably  larger  than  w,  the  size  of  the  neighborhoods  in 
the  graph  topology. 

The  micro-statistical  approach  will  lead  to  fast  computing  when  compared  to 
stochastic  relaxation,  but  we  pay  for  this  by  sacrificing  some  global  information 
as  will  be  mentioned  in  Section  3.  The  optimality  criteria,  on  which  the 
algorithms  will  be  based,  will  be  local  so  that  we  shall  deal  with  another 
optimality  criterion  tha  »  the  MAP  methods. 
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But  computational  speed  is  not  the  only  issue  here.  We  know  (see  the 
preceding  report  in  this  series)  that  sometimes  we  are  forced  to  use  local  methods, 
for  example  when  we  allow  occlusion  in  the  scene,  or  when  the  objects  have 
internal  degrees  of  freedom.  It  is  then  natural  to  apply  the  micro-statistical 
approach. 

To  illustrate  the  approach  some  computer  experiments  have  been  carried  out, 
so  far  only  in  very  limited  situations,  by  Johan  Berglind.  It  is  too  early  to  make 
any  definitive  claims,  but  the  experiments  at  least  established  the  feasibility  of 
micro-statistical  algorithms  in  the  special  circumstances  examined. 


2.  Formalizing  micro-statistical  concepts.  To  fix  ideas,  say  that  the  connector 
graph  a  is  a  square  lattice  of  size  LxL  in  the  plane  and  denote  its  sites  by 
z«(x,y),  where  x,y  »  0,1,2,...L-1.  Further  we  assume  the  lattice  to  be  periodic  and 
have  the  usual  closest  neighbor  topology,  w-4.  The  pure  images  I  will  be  binary, 
I(x,y)  -0  or  1,  while  the  deformed  (observed)  images  ID  may  be  B/W  or  gray  level, 
ID(x,y)  €  C,  with  a  background  space  C  of  arbitrary  cardinality.  For  simplicity  we 
also  assume  that  the  noise,  conditioned  by  I,  is  i.i.d.,  so  that  it  is  enough  to  specify 
a  conditional  density  pQ 


(1) 


pn(a,b)  -  p[ID(x,y)  -  a  1 1] 
b  -  I(x,y) 


None  of  these  assumptions  is  essential  for  the  following  and  can  easily  be 
extended  to  more  gene.,  '.tuations. 

We  si>3‘l  think  of  the  pure  images  as  discretized  versions  of  sets  in  R2  with 
boundaries  that  are  piecewise  smooth,  and  where  the  length  scale  l/L  is  small. 
The  points  t  -  (l,n)  of  the  unit  square  (actually  2-torus)  with  0  <  {,0  <  1  are  made 
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to  correspond  to  the  lattice  points  2  of  the  digital  image 
’  l  -  x/L 

(2) 

n  -  y/L 

2.1.  Look  at  the  scene  in  through  a  square  window  centered  at  (l,o) 

(3)  <  8,  \n'-*\  <  8). 

We  then  see  a  slice  of  the  pure  digital  image 

Ixy  -  {I(x *,y •)  with  |x'-x|  <  8L,  jy'-y|  <  6L} 

(4)  ■  1  11 

x  «  IL,  y  ■  nL 

if  are  multiples  of  the  length  scale  1/L. 

How  will  these  slices  look  for  small  8  and  large  L?  Three  cases  can  occur: 

1.  Ixy  is  identically  0,  all  its  points  outside  of  the  objects. 

2.  IXy  is  identically  1,  all  its  points  inside  the  objects. 

3.  I xy  consists  of  points  both  inside  and  outside  the  objects. 


In  the  third  case  a  boundary  separates  points  inside  and  outside.  This 
boundary  is,  asymptotically  straight,  unless  we  happen  to  be  at  a  corner  point  of 
the  object  -  then  the  boundary  is  asymptotically  that  of  the  outside  or  inside  of  a 
triangle  (unless  the  smooth  boundary  arcs  meet  at  angle  *  0*  or  180*  which  will 
be  ruled  out  for  convenience).  Higher  order  approximations  may  be  required. 

22k  Introduce  now  formally  a  set  U  of  slices .  a  slice,  generically  denoted 
u,  being  a  subset  of  a  square  Q  ■  (-1,1)  x  (-1,1).  The  boundary  separating  0  from 
1  in  Q  of  a  slice  is  called  its  divider.  For  any  n  €  U  we  consider  the  set  Ixy  of 
pure  images  I  €-^  for  which  the  restriction  to  the  lattice  points  (x\y’) 

(5)  j x ' -x |  <  8L,  |y'-yj  <  8L 


we  have 
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Here  we  use  the  symbol  u  also  to  denote  the  indicator  function  of  the  set  u. 

A  prior  P  on  /  will  induce  a  probability  measure  P  on  the  set 
^y«{l]|y|u€U}  in  the  following  way.  If  U  is  finite  we  introduce 


(7) 


PUSIy)  - 


PflXy) 


ueu 


PdUy) 


assuming  of  course  that  the  denominator  in  (7)  is  not  zero.  If  U  is  a  subset  of 
some  we  introduce  P  by  densities,  say  with  respect  to  Lebesgue  measure  in 
in  analogy  with  the  expression  in  (7). 

P  is  our  micro-statistics  and  we  shall  use  the  above  construction,  with 
appropriate  modifications  as  needed,  in  several  cases. 

First  let  us  consider  some  slice  families  U. 

E XJL  Let  U  consist  of  all  sets  obtained  as  the  intersection  of  Q  with  a 

half-plane.  In  particular  u«0  shall  mean  the  empty  set  and  u»l  the  full  set  Q. 
The  divider  will  thus  be  empty  or  a  straight  line  segment. 

Ex.2.  Let  U  consist  of  all  sets  obtained  as  the  intersections  of  Q  with 
the  union  or  intersection  of  two  half  planes.  Then  U  contains  all  the  slices  from 
Ex.  1  but  also  wedges.  The  wedges  will  approximate  the  local  behavior  of  a 
boundary  point  of  an  object  where  the  tangent  direction  jumps. 

Ex.3.  The  two  previous  slice  sets  have  boundaries  consisting  of  zero, 
one,  or  two  line  segments.  An  obvious  extension  is  obtained  by  letting  the  divider 
be  a  conic  section,  or  two  conic  arcs  joined  together. 
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2.3.  We  are  now  ready  to  describe  the  local  restoration  procedure  based  on 
the  micro-statistics  family  U.  Consider  an  arbitrary  site  z  -  (x,y)  and  form  the 
joint  frequency  function  f  of  the  micro-statistic  u  and  the  observed  image  in  the 
window  centered  at  z  (solve  (6)  for  u((,n» 

(8)  f-P(u)  II  pnlI®(x+SL(,  y+8Ln|uU,n)] 

where  the  product  is  over  the  window  used. 

The  expression  in  (8)  assumes  a  discrete  U-family  of  slices.  If  U  is 
continuous  a  factor  for  the  Jacobian  should  also  be  needed. 

Now  make  the  decomposition 

(9)  U  «  U°  U  U1 

where  Uq  consists  of  all  slices  with  u(0,0)  -  0  and  Uj  contains  the  ones  with 
u(0,0)  -  1.  Introduce  the  probabilities 


(10) 


n0  “  1  0f 
u€U° 


"1 


E  f 


u€U 


1 


and  use  as  the  optimality  criterion  for  the  restoration  minimum  expected 
Hamming  The  resulting  algorithm  for  restoration  based  on  the  micro-statistical 
family  U  is  then  simply 


(ID 


I*(x,y)  - 


0  if  n0>  n, 
1  if  ff0<n, 


and  randomized  l*(x,y)  in  the  exceptional  case  ffQ-nj. 
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2.4.  Let  us  look  at  this  algorithm  for  the  special  cases  in  2.2.  If  we  denote 
the  length  of  our  digital  square  28L  by  m  we  get  the  following 

Eld*  The  cardinality  |U|  -  12m2  (enumerate  the  two  points  of 
intersection  between  the  divider  and  the  boundary  of  the  digital  square),  so  that  if 
m«5  we  get  about  300  slices.  We  precompute  the  p(u)  values  for  these  slices.  For 
each  of  these  slices  we  must  compute,  for  all  z»(x,y),  the  product  in  (8),  with 
m2-25  multiplications.  Thus,  for  each  site  we  need  about  7S00  operations.  The 
step  in  (11)  consists  of  just  a  single  comparison.  Note  that  with  this  approach  alL 
the  sites  can  be  processed  in  parallel.  If,  for  example,  L-256,  we  need  order  of  1 
sec  on  the  STAR.  If,  instead,  truly  parallel  hardware  is  available  execution  time 
is  probably  negligible.  And  this  is  with  no  attempt  at  speed  up  of  our  algorithm! 

Ex.2.  Now  when  the  slices  also  include  wedges,  so  that  our  algorithm  is 
a  boundarv-and-corner  detector .  we  get  a  larger  slice  family  U,  25  times  as  big  (the 
corner  point  of  a  wedge  has  m2  possible,  positions)  if  all  wedges  are  included.  The 
need  for  parallel  hardware  is  then  accentuated  unless  algorithmic  speed  up  can  be 
achieved  (which  seems  likely).  In  the  pure  image  we  would  normally  expect  most 
points  to  be  internal  or  external,  fewer  would  be  on  a  boundary,  and  very  few 
would  be  corners.  Perhaps  this  can  be  exploited  for  speed  up  at  the  price, 
naturally,  of  more  complicated  program  logic. 

Ex.3.  When  we  allow  more  general  form  for  the  divider  the  cardinality 
of  the  slice  family  U  will  increase.  This  changes  little  in  principle  but  at  present 
it  is  unclear  whether  the  increase  in  restorative  power  motivates  the  greater 
computing  effort  that  will  be  required. 

Actually,  the  issue  here  is  related  to  the  discussion  in  the  preceding  report 
in  this  series  dealing  with  the  'car  experiment'.  It  is  only  when  we  have  detailed 
information  a  priori  concerning  pattern  structure  that  it  will  pay  off  to  base  the 
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analysis  on  micro-statistics  parametrized  by  boundary  arcs  represented  by  dividers 
forming  a  larger  U-space  than  in  Ex.  1  and  2. 

2.5.  Let  us  make  some  additional  remarks  on  the  implementation  of  the 
idea  of  micro-statistics. 

Remark  1.  The  choice  of  prior  on  U  can  of  course  be  derived  from  the 
prior  on  J7*.  This  was  done,  at  least  approximately,  in  Berglind’s  computer 
experiment  using  the  Ising  model.  It  could  also  be  done  for  more  interesting 
image  models. 

It  is  tempting,  however,  to  choose  the  measure  on  U  directly,  and  perhaps 
estimate  it  directly  from  data.  This  has  not  been  tried  yet  but  should  be  examined 
analytically  and  experimentally.  If  we  do  this  we  should  also  pay  attention  to  the 
problem  whether  such  a  specification  is  consistent,  in  the  sense  that  the  slice 
distribution  p  on  U  can  be  obtained  as  a  local  approximation  of  any  full  prior  P 
on  3T. 

Remark  2.  Consider  for  a  moment  the  deformation  mechanism  D  where 
inside  points  result  in  N(mQ,o^)  values  and  outside  points  in  N(mj,o^)  values.  In 
practice  mQ  and  mj  are  unlikely  to  be  known  a  priori  and  we  have  studied  how 
they  can  be  estimated,  for  example  using  the  half  variance  method. 

However,  we  could  allow  the  m’s  to  vary  slowly  over  the  image,  and  estimate 
them  locally  for  each  slice  u.  This  looks  like  a  realistic  alternative,  at  least  when 
the  slice  window  is  large  enough  so  that  the  statistical  variability  of  the  estimates 
is  small  enough. 

Remark  3.  We  have  limited  our  discussion  so  far  to  set  patterns:  the  pure 
images  are  binary.  Nothing  prevents  us,  however,  from  applying  the 
micro-statistical  approach  to  contrast  patterns:  the  pure  images  take  contrast 
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values  in  a  space  of  higher  cardinality.  The  slices  could  then  be,  for  example, 
polynomial  approximations  to  I(*,*)  obtained  from  a  Taylor  expansion. 

Remark  4.  Finally  an  idea  that  is  only  speculative.  For  each  location  z  we 
use  micro-statistics  from  its  associated  window,  this  is  done  separately  for  all 
locations.  This  is  attractive,  both  because  it  follows  from  an  optimality  reasoning 
and  because  it  can  be  implemented  in  parallel.  Nevertheless,  it  may  be  possible  to 
gain  in  restorative  power  by  linking  overlapping  slices  together,  let  them  be 
coupled.  Is  there  anything  in  this  idea?  I  feel  uneasy  about  it  since  it  contradicts 
our  general  strategy  to  derive  model  based  methods  •  linking  slices  together  is 
more  of  an  ad  hoc  idea. 

3.  Summary.  The  advantages  of  the  micro-statistical  approach  are  a)  it 
is  single  phase  (not  iterative  with  questionable  speed  of  convergence),  b)  it  seems 
to  reduce  computing  drastically  (note  that  it  avoids  simulation),  and  c)  it  is  based 
on  an  optimality  criterion  that  is,  at  least  to  some  extent,  meaningful  and 
natural. 

The  main  disadvantage  that  I  see  in  it  at  present  occurs  when  c)  is  not  true. 
Indeed,  we  give  up  some  global  cohesiveness,  and  for  this  reason  the  restored 
images  may  simply  not  "look  right".  Only  further  study  and  systematic 
experimentation  will  show  if  and  when  this  is  a  serious  objection.  This  is  of 
course  related  to  Remark  4. 
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Appendix  2 

Parallel  Logic  Under  Uncertainty.  Continued  and  Applied 
to  the  "Car  Experiment* 

1.  Present  status  of  problem.  The  study  carried  out  by  our  group  is  object 
identification,  to  be  implemented  in  the  car  experiment,  has  dealt  witli  a  number 
of  issues  and  it  is  time  to  take  a  look  at  what  we  have  done.  The  following  list  is 
not  complete  but  will  help  to  clarify  the  situation  and  plan  the  continuation. 

1.1.  We  have  assumed  that  the  scene  contains  one  or  ho  object  of  a  finite 
number  na  of  prescribed  types,  denoted  a;  cM,2,...ncf  The  scene  is  viewed  at  a 
distance  r  and  from  an  elevation  angle  both  of  which  are  assumed  known. 

1.2.  The  object  is  assumed  to  be  rigid  and  opaque  so  that  it  has  no  internal 
degrees  of  freedom.  Call  the  location  z  in  the  object  plane,  where  z  is  some 
distinguished  point,  for  example  the  centroid  of  the  object.  Also  denote  the 
orientation  of  the  object  by  $,  where  $  is  the  angle  between  some  distinguished 
direction  of  the  object  and  a  fixed  orientation  in  the  object  plane.  Hence  z  e  R2, 
HO, 2n) . 

1.3.  Observing  the  scene  we  denote  the  view  by  1®,  where  I®  is  a  digital 

LxL  pixel,  grey  level  picture  in  the  image  plane  orthogonal  to  the  line  of  sight. 
The  distance  r  is  assumed  big  enough  so  that  wc  can  limit  ourselves  to  orthogonal 
projections,  but  this  is  easy  to  modify  if  turns  out  to  be  desirable.  The 
deformed  image  I®  represents  in  addition  to  the  object,  if  any,  noise  from  the 
observational  set  up  and  a  noisy  background  (clutter).  At  present  we  model 
ibis  simply  by  two  i.i.d.  samples  Gaussian  random  vr, cables 

where  m^mQ  inside  the  object  area  and  m^m,  outside.  This  will  probably  be 
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replaced  by  two  stationary,  but  not  necessarily  isotropic,  Gaussian  stochastic 
processes  for  object  and  background.  To  handle  this  extension  analytically  we 
have  discussed,  at  an  early  stage  of  our  work,  to  use  Toeplitz  approximations; 
this  can  wait  since  we  are  familiar  with  such  mathematical  techniques. 

1.4.  We  have  developed  boundary  detectors  using  Bayesian  estimators 
derived  from  various  Markovian  models  of  the  shape  of  the  object.  The  simplest 
of  these,  the  Ising  model,  expresses  only  clumping  tendencies.  While  it  is  of 
theoretical  interest  it  includes  too  weak  prior  information  about  object  shape  to  be 
a  serious  candidate  for  our  continued  work. 

Two  other  lattice  based  models;  closely  related  to  each  other,  express  more 
detailed  prior  shape  structure;  one  is  the  pixel*edge  model,  the  other  is  built  on 
generators  representing  geometric  tendencies  of  the  boundary. 

Still  another  model  is  continuum  based  and  expresses  the  boundary  as  a 
spline,  in  the  simplest  case  reducing  to  a  polygonal  boundary. 

The  parameters  mQ,mj,e^  cannot  be  assumed  to  be  known  in  advance.  To 
deal  with  this  we  proposed  and  studied  the  half  variance  method,  which  seems  to 
work  fairly  well  but  needs  some  work. 

1.5.  The  experimental  set  up  uses  small  model  cars,  painted  white  and,  so 
far,  located  on  a  black  background.  The  digital  image  is  processed  using  various 
boundary  detectors,  in  order  to  get  a  better  feeling  for  how  the  estimates  of  the 
boundary  behave  statistically. 

1.6.  The  work  undertaken  by  the  Hughes  group  should  be  of  great  help  in 
this.  A  careful  data  analysis  of  the  results  should  make  it  possible  to  firm  up  the 
mathematical  models  to  be  used  as  we  go  along  in  our  joint  work  with  them. 

In  an  early  stage  of  our  study  we  discussed  the  possibility  of  applying 
stochastic  relaxation  to  a  vector  of  selected  statistics  computed  from  an  estimate 
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of  the  boundary.  At  that  time  we  were  thinking  of  statistics  such  as  the  area  of 
the  convex  hull,  the  degree  of  concavity,  the  lengths  of  diameters,  and  many 
others.  The  result  of  a  successful  data  analysis  should  help  pinpoint  good  such 
statistics.  This  can  be  viewed  as  the  selection  of  hash  functions,  but  the  noisiness 
of  data  makes  for  an  unconventional  form  of  hashing.  As  will  be  suggested  below 
we  may  be  able  to  replace  this  by  a  less  arbitrary  approach. 

1.7.  We  have  pointed  to  the  important  correspondence  problem  between  the 
true  and  estimated  boundaries.  This  is  a  case  of  unlabelled  observations. 

To  deal  algorithmically  with  the  correspondence  problem  we  discussed  a 
dynamic  programming  approach.  Since  it  seems  to  require  a  massive 
computational  effort  we  may  have  to  look  for  substitutes  involving  less  computing. 

1.8.  We  have  studied  the  problem  of  optimal  image  approximation  when 
a  piecewise  smooth  boundary  is  approximated  oy  a  polygon  or  possibly  by 
other  splines.  The  analytical  result  has  been  tried  on  real  pictures  and  seems 
to  work  well.  The  result  will  be  applied  systematically .  later  on,  when  we 
shall  use  it  to  obtain  data  compression  when  storing  object  profiles. 

2.  Research  strategy.  We  have  not  yet  attempted  to  put  these  pieces 
together  to  obtain  an  integrated  solution  to  our  problem  in  object  identification.  1 
think  it  is  time  to  start  doing  this  during  the  academic  year  just  begun.  As  a 
preparation  let  us  examine  the  general  approach  we  have  been  using,  explicitly  or 
not. 

2.1.  A  guiding  principle  for  our  work  has  been  the  model  based  paradigm: 
algorithm  for  pattern  analysis  should  be  derived  from  clearly  stated  mathematical 
models.  Not  only  should  the  patterns,  say  shapes  of  objects,  be  described 
mathematically  in  detail,  but  the  same  should  hold  for  the  whole  chain  involving 
patterns  and  their  generation,  the  observer,  the  deformation  mechanism,  and  the 
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algorithms  for  inference.  The  links  in  this  chain  should  be  integrated. 

2.2.  Another  tendency  is  reductionism :  the  model  construction  should  be 
reduced,  as  far  as  possible,  to  first  principles.  In  the  case  of  our  car  experiment  it 
means  that  we  should  emphasize  the  mathematical  generation  of  shape,  the  pure 
image,  this  should  be  the  starting  point. 

How  to  do  this  depends  upon  the  degree  of  variability  of  the  shapes 
encountered.  In  the  car  experiment  as  envisaged  so  far  we  have  only  three  degrees 
of  freedom,  two  for  z  and  one  for  6  The  nuisance  parameter  is  hence  low 
dimensional,  6  -  (z,$)€  fP.  As  will  be  suggested  below  we  should  go  along  to 
higher  dimensional  nuisance  parameters  which  will  force  local  methods  upon  us,  and 
we  shall  factor  our  problem  into  many  small  ones  of  low  dimensionality;  this  will 
be  made  clearer  below.  In  a  related  study,  the  leaf  shape  project,  we  meet  the 
extreme  of  this,  when  the  8-space  is  infinite,  or  at  least  very  high,  dimensional. 

2.3.  We  also  aim  for  generality.  The  choice  of  the  car  experiment  is 
motivated  not  only  by  practical  considerations,  but  also  for  its  concreteness. 
Nevertheless,  we  hope  that  the  results  will  extend  to  much  more  general  situations. 

To  make  this  possible  I  suggest  that  we  extend  the  problem  to  allow  for 
several  objects  and  allow  occlusion.  This  will  increase  the  number  of  d.f.  We 
should  also  allow  internal  d.f.’s,  for  example  nuisance  parameters  representing 
relative  angles  of  parts  that  can  be  mov..d,  say  of  doors,  wheels,  etc.  Or, 
parameters  expressing  the  distribution  of  albedo,  temperature,  etc.  over  the  object 
surface. 

Perhaps  this  sounds  too  ambitious  at  the  present  time,  but  we  shall  outline  a 
methodology  for  inference  intended  for  such,  more  general  pattern  structures.  It 
is  based  on  the  idea  of  parallel  logic  under  uncertainty  that  I  have  suggested 


elsewhere. 


-93- 


3.  Formalizina  the  fictorin«  of  the  problem.  Now  let  us  be  more  specific. 
In  order  to  achieve  greater  descriptive  power  we  shall  use  a  continuum  based 
approach,  not  a  lattice  based.  The  generators  will  be  chosen  as  directed  analytic 
arcs,  have  arity  two,  with  in-bond  equal  to  the  start  point  of  the  arc  and  out-bond 
equal  to  the  endpoint.  The  analytic  form  of  the  arc  will  be  left  open  until  the 
completion  of  the  data  analysis  based  on  the  experimental  data  collected  by  the 
Hughes  group. 

The  natural  similarity  group  S  is  here  simply  the  translation  group  in  the 
image  plane.  We  shall  not  use  the  full  Euclidean  group,  since  rotations  of  the 
object  in  around  a  vertical  object  does  not  correspond  to  rotations  in  the  image 
plane;  instead  of  simple  rotations  we  meet  more  complicated  transformations  of 
the  image. 

The  bond  relation  p  will  be  taken  as  EQUAL,  meaning  concatenation  of  arcs, 
and  the  connection  type  £  ■  CYCLES,  so  that  each  connector  graph  o  consists  of  a 
finite  number  of  closed  cycles.  This  choice  of  E  will  be  seen  to  have  crucial 
algorithmic  consequences  later  on. 

This  regularity  R  -  <EQUAL,CYCLES>  over  G  via  S  defines  a  regular 
configuration  space  5f{K).  We  shall  use  a  subspace  Sf'(K)  £  5f(R)  consisting  of 
the  profiles  obtained  by  placing  a  finite  number  k  of  objects  of  given  types  in  the 
image  plane;  the  profiles  may  overlap  or  be  disjoint. 

An  object  is  described  by  a  vector  (ot,0j,02,.-0a)  where  the  0's  are  the 
nuisance  parameters  and  we  use  the  convention  that  0j-x,  ©2-y,  83*$  with  z-(x,y). 
The  remaining  0's  represent  the  internal  degrees  of  freedom. 

We  shall  assume  the  following  construction  of  the  objects;  the  reason  behind 
this  assumption  will  become  clear  later.  Each  object  is  made  up  of  rigid  parts, 
joined  by  hinges  in  such  a  way  that  the  orientation  of  any  of  its  parts,  say  the 
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one,  is  uniquely  defined  by  the  principal  orientation  angle  83-$  and  one  hinge 
angle  ^  This  is  a  sort  of  separability  condition',  only  first  order  interactions 
between  83  and  any  0^  v  >  4,  are  allowed. 

A  similar  reasoning  will  be  applied  when  we  get  to  nuisance  parameters 
representing  the  temperature  or  albedo  distribution  over  the  surface  of  an  object; 
this  will  be  dealt  with  later.  Here  we  note  only  that  boundary  statistics  will  then 
be  replaced  by  what  could  be  called  surface  patch  statistics. 

Let  us  write 

m 

(1)  #'<*)-  u 

k»0 

where  5f^(R)  is  the  subset  of  if'  (R)  with  k  objects.  Then  5fj^(R)  can  be 
parametrized  by  the  vector 

(2)  (5,3)  «  (a1,01,a2,02,...ak,0k)  . 

The  value  of  k  in  practice  is  likely  to  be  small.  Nevertheless  the  dimension  of  the 
(a,€)-space  may  seem  prohibitively  large,  both  for  string  of  the  profiles  and  for 
the  decision  algorithms  to  be  developed  for  inference.  Can  it  be  done  even  for  the 
case  we  have  dealt  with  so  far,  k«l  and  d-3? 

First,  it  is  clear  that  the  two  d.f.  for  Oj-x.Oj-y  cause  no  trouble.  Indeed,  we 
need  only  store  the  profiles  in  standard  location,  say  z-0,  and  the  decision 
algorithm  can  be  based  on  differences  of  arc  points  in  R2,  relative,  not  absolute 
coordinates.  For  03-$  we  could  have  done  something  similar  if'  it  had  corresponded 
to  rotations  in  the  image  plane.  Since  this  is  not  so  we  must  store  enough 
information  to  describe  the  profiles  for  different  03-vaiucs.  Perhaps 
03«O,1O#,2O  *,...350°  will  be  enough  practically,  which  means  36  03-values. 
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Now  let  us  consider  another  d.f.,  84,  say  an  internal  angle.  The  moveable 
parts  of  the  objects  have  been  assumed  to  be  joined  by  hinges  whose  angles  are  the 
8^  v«4,2,...d.  Obviously,  we  can  not  hope  to  store  profiles  for  all  discretely  chosen 
combination  of  but  this  is  not  needed.  This  is  where  factoring  comes 

in.  Indeed,  it  is  enough  to  store  outlines  for  the  rigid  parts  for  a  sufficient 
number  of  combinations  (83.®^).  where  v  >  4.  Perhaps  we  will  have  to  store  362, 
but  not  36t*"2,  profiles  for  each  arc:  the  problem  has  been  factored,  reducing 
storage  drastically. 

We  shall  need  a  prior  on  the  configuration  space  as  always  for  a 

Bayesian  approach.  Since  we  have  widened  our  problem  by  allowing  several 
objects,  k  can  be  larger  than  one,  and  by  letting  objects  have  internal  degrees  of 
freedom,  d  can  be  larger  than  3,  so  that  the  prior  lives  on  a  larger  parameter 
space.  The  choice  of  prior  speeds  more  discussion,  but  at  this  time  let  us  only 
consider  the  probability  distribution  of  k,  qk  for  k  »  0. 

We  do  not  see  any  reason  for  any  particular  analytical  form  for  qk  in 
general,  but  only  note  that  it  expresses  the  principle  of  Occam's  razor  if  its  tail  is 
short.  Say,  quite  arbitrarily,  that  we  use  a  geometric  distribution 

1  v 

(3)  qk  -  - —  p  ,  k»0,l,... 

for  the  present  and  leave  the  final  choice  till  later.  The  value  of  p  should  be 
small. 

The  ideal  observer  cannot  always  see  the  whole  configuration  c  €  5f(R),  since 
objects,  or  parts  of  objects  may  hide  each  other.  That  means  that  the 
identification  map  R:  Sf' (R)  -*  S  will  only  preserve  boundary  information  of  the 
visible  profiles. 
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The  deformation  mechanism  D:  S' •*  will  be  chosen  as  before,  two  i.i.d. 
Gaussian  samples  from  inside  and  outside  the  pure  image  I. 

4.  Choice  of  inference  algorithm.  The  fact  that  we  now  allow  k  and  d  to  be 

greater  than  one  and  three  respectively  has  an  important  and  obvious  consequence 

for  the  construction  of  the  inference  algorithm.  It  is  clear  to  anyone  who  has 

considered  the  multi-object  situation  with  partial  occlusion,  that  are  now  led  to 

base  the  inference  on  local  statistics.  Simple  template  matching,  computationally 

feasible  or  not,  will  not  work,  since  we  cannot  be  sure  that  we  are  dealing  with 

Jk 

one  and  the  same  object  throughout.  Instead  we  have  to  break  up  the  estimated 
boundary,  say  (61)*,  into  pieces  and  extract  local  inforrration  from  each  piece. 

4.1.  I  am  not  going  to  argue  against  this,  but  would  like  to  point  to  an 
obscure  link  in  the  reasoning. 

Our  deformed  image  I33  is  an  LxL  digital,  grey  level  picture.  When  we  base 
the  inference  on  the  estimated  boundary  we  really  employ  a  plausibility  argument 
implicitly.  In  the  spirit  of  our  whole  approach  we  ought  to  give  this  an  analytical 
foundation  and,  at  the  same  time,  make  the  statement  mathematically  precise. 

The  above  will  become  clearer  if  we,  only  momentarily,  go  back  to  the 
original  case  k»l,  d»3.  Consider  a  boundary  detector  9*,  an  estimator  of  91,  so 
that  9*:_^'33  *•  {91}.  If  9*  could  be  shown  to  be  a  sufficient  statistic  we  would  be 
on  firm  ground,  but  I  am  convinced  that  this  is  not  the  case  (this  should  be  shown 
rigorously). 

However,  we  may  be  able  to  make  an  asymptotic  statement,  almost  as  strong, 
in  terms  of  the  linear  length  scale  «  ■  1/L.  Can  one  show  that  some  9*  is 
t- sufficient  when  L  -*  *?  Someone  in  our  group  ought  to  settle  this  question.  It 
may  turn  out  that  some  boundary  detectors  9*  are  c-sufficient,  or  contain. 
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asymptotically,  all  the  relevant  information  in  the  sample  in  terms  of  some  other 
formalization,  while  others  are  not,  and  this  would  have  practical  consequences  for 
the  design  of  the  inference  algorithm  and  choice  of  8*. 

4.2.  Let  us  now  return  to  the  general  problem,  k  >  0,  d  >  3.  Say  that 
we  have  decided  to  use  a  particular  estimator  9*  and  we  have  obtained  a 
boundary  9*1®,  consisting  of  one  or  more  closed  curves.  If  there  are  several 
topological  components  in  9*1®,  let  us  consider  a  single  one  of  them  at  first. 

The  directed  and  closed  curve,  (*,  is  hoped  to  contain,  asymptotically  all  the 
relevant  observations  in  the  sample.  Divide  into  N  arcs  of  equal  length,  say 
•  Cfo.l  and  consider  the  jth  one  Cj.  Some  hints  for  choosing  N  will  be  given 

later 

The  local  information  contained  in  shall  be  calculated  as  follows.  Return 
to  a  pure  (undeformed)  image  I  in  R2,  consisting  of  a  single  object.  Consider  a 
directed  arc  (  belonging  to  the  boundary  of  these  objects.  Parametrize  £  as 
h«(a,8,SQ,Sj)  where  a  is  the  pattern  type  of  the  object,  9  its  nuisance  parameter 
and  Sq  and  Sj  the  start  and  endpoint  of  (  measured  in  arclength  from  some 
conveniently  chosen  point  in  the  boundary  of  the  same  object  a  and  same  0-value. 
This  h  will  be  our  local  hypothesis.  h€H  where  H  is  the  full  hypothesis  space.  Note 
that  it  is  a  simple  hypothesis. 

4.3.  Now  go  back  to  the  deformed  image  and  the  directed  arc  5* 
Introduce  the  probability  that  an  arc  {  gives  rise  to  5*  as 

(4)  Qtt*,!;)  -  PU  -  tj). 

To  avoid  misunderstanding  let  us  emphasize  that  (  stands  for  an  arbitrary  arc  of 
the  boundary  of  an  object  profile,  it  need  not  coincide  with  one  of  the  full 
analytic  arc  s  generating  the  spline. 
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Also  let  us  mention  for  later  reference  that  it  may  very  well  happen  that 

originates  from  two  object  boundaries,  one  object  occluding  the  other.  This  is 

more  likely  to  happen  if  t*  is  long,  or  N  is  small,  so  that  this  indicates  that  one 
should  choose  N  moderately  large,  perhaps  15-25. 

For  a  specified  estimator  9*  it  should  be  possible  to  calculate  analytically  the 
probability  in  (  )  asymptotically,  but  I  suggest  that  we  postpone  this  for  the  time 
being. 

If  and  when  we  can  determine  Q  asymptotically  we  shall  introduce  the  local 
hypothesis 

(5)  h(5j)-{tjQ(Uj)>6}€H 

for  some  threshold  value  6.  However,  I  propose  that  we  use,  tentatively,  the 

following  heuristic  way  of  determining  the  local  hypotheses.  Give  with 

endpoints  z®  (start)  and  z1  (end)  find  the  set  h((p  of  (’s  that  have  the  same 
endpoints  (counted  in  the  same  direction!).  Since  our  similarity  group  consists  of 
translation  of  R2  it  is  enough  to  search  for  an  arc  £  such  that  the  vectors  z^z0 
and  (  (endpoint)  -  (  (start  point)  are  equal.  How  to  realize  this  algorithmically  in 
a  feasible  way  deserves  careful  attention,  but  it  is  clear  that  this  is  much  less 
demanding  computationally  than  the  dynamic  programming  approach  discussed  in 
our  group.  If  it  is  a  good  way  is  another  matter.  For  an  arc  t€h((p  with  length 
parameters  S|  and  $2  introduce  a  distance  measure  like  the  following,  perhaps  in  a 
modified  form, 

m 

(6)  dUU)-  Z  |z*-zv| 

v-0 

where  m+1  is  the  number  of  lattice  points  z£  on  and  zv  are  m  equidistant 
points  on  (.  The  exact  form  of  the  distance  criteria  is  not  important  at  this 
preliminary  stage,  but  will  be  later.  What  is  important,  however,  is  that  d  should 
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measure  distance  between  directed  arcs,  and  not  be  of  the  form  of  a  Hausdorff  (or 
similar)  distance  between  sets. 

Then  let  us,  again  tentatively,  replace  h({*)  by 

(7)  h«J)  -  (5 1  tehttjf),  d«},0  <D)CH 

with  another  threshold  constant  n.  The  subsets  h((j)  of  H  will  be  though  of  as 
our  plausible  local  hypotheses.  Note  that  they  are  composite  hypotheses  in  contrast 
to  the  pure  hypotheses  h  mentioned  earlier. 

From  now  on  we  shall  discard  arc  length  information,  the  Sq.Sj  values  in  h. 
Instead  we  project  the  local  hypothesis  to  the  space  H'  consisting  of  (a-8)- 
vectors,  say  h\  only.  Denote  the  projected  set  thus  obtained  from  h(;+)  by 
h’ttj). 

Recalling  that  our  adopted  connection  type  E  *  CYCLES,  it  is  clear  that  our 
inference  problem  deals  with  estimating  an  unknown  connector  a  in  this  set  E.  Think 
of  the  arcs  j-0„l,...N-l;  as  the  nodes  in  o,  not  as  the  segments,  and  use  acceptor 
functions 

(8)  A(hjl,hj2)-«d'(hj2,hjl)] 

where  4>  is  a  positive  decreasing  function  and  d'  an  appropriate  distance  in  H'. 
We  shall  now  try  h  maximize  the  criterion 

(9)  C(o*;h0,h1,..hN.1)  -  q(k*)  n  A(hj  hj ) 

o*  i  z. 

where  o*  €  E,  k*  ■  number  of  cycles  in  o*,  hj  €  hj,  and  the  product  is  taken  over 
segments  (jj^)  in  o*.  To  achieve  this  we  apply  stochastic  relaxation  with 
annealing  to  C(o*;  hQ,hj,...hN.j). 

Let  us  mention  in  passing  that  the  way  we  have  outlined  our  recognition 
algorithm  the  value  of  k  means  the  number  of  cycles  (wholly  or  partly  visible 


objects)  in  it  topological  component  of  I.  It  does  no  longer  mean  the  total  number 
of  objects  in  the  scene. 

Two  decisions  must  be  made  to  implement  stochastic  relaxation:  how  to 
i  nitialize  d*,hQ,hj,~hN.i,  and  what  should  be  the  elementary  up  date  operations  of 
the  relaxation  scheme. 

Two  suggestions  for  initialization:  1)  Choose  initially  o*  as  a  single  cycle, 
or,  2)  Consider  the  joint  plausible  hypothesis  set 
N*1  , 

(10)  U  hjCH' 

j-0  1 

and  use  some  clustering  algorithm  to  get  a  rough  idea  of  how  many  clusters  there 
are  in  the  set.  Use  a  o*  with  this  number  of  cycles  distributed  as  the  analysis 
indicates  over  the  j-values. 

The  elementary  up  date  operations  should  certainly  involve  replacing  an  hj, 
regarding  the  rest  and  o*  as  fixed. 

It  is  less  clear  what  operations  we  should  use  changing  o*.  I  suggest,  as  a 
minimum,  that  we  include  cut-and-  join  operations  as  indicated  in  the  figure  below, 
which  take  (a)  into  (b)  or  (b)  into  (a). 
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The  decision  on  choosing  the  elementary  up  date  operations  must  be  made  in 
such  a  way  that  the  class  of  operations  if  complete',  given  two  connectors  Oj  and  Oj 
in  CYCLES  there  should  exist  a  chain  of  elementary  up  date  operations  that 
changes  Oj  into  o2*  I  believe  that  the  above  choice  leads  to  a  complete  class. 

The  conditional  probabilities  associated  with  these  up  dates  and  (9)  are 
easily  calculated,  note  that  k*  may  change  so  that  the  factor  q(k*)  in  (9)  affects 
them,  implementing  a  reasoning  of  type  Occam’s  razor. 

Repeating  updating,  successively  lowering  temperature,  and  having  iterated 
many  times  we  stop  the  process.  Our  recognition  algorithm  has  as  its  result  that 
we  set  k*  objects  with  ctrvalues  as  distributed  over  the  current  plausible  local 
hv  no  theses  hj.  As  a  side  result  we  also  get  estimates  for  the  nuisance  parameters. 

5.  Discussion  of  proposed  algorithm.  The  presentation  in  the  previous  section 
is  only  a  sketch  with  many  details  missing  and  decisions  to  be  made  before  the 
algorithm  is  completely  specified.  Nevertheless,  I  hope  that  the  description  is 
sufficiently  clear  to  serve  as  a  starting  point  for  our  continued  work. 

The  approach  is  basically  the  same  as  the  one  we  decided  upon  a  couple  of 
years  ago,  the  main  difference  being  that  it  does  not  rest  on  the  solution  of  a 
more  or  less  arbitrary  set  of  features  characterizing  the  estimated  boundary  and 
the  set  it  encloses.  Instead  we  try  to  exploit  as  much  as  possible  of  the 
information  contained  in  the  observed  image  and  handle  it  by  a  procedure 
implementing  parallel  lotic  for  noisv  data.  It  is  also  more  ambitious  in  that  it  is 
intended  for  multiple  object  scenes  and  objects  with  internal  degrees  of  freedom. 

But  is  it  over  ambitious?  Can  algorithms  of  the  type  suggested  be  processed 
using  computer  technology  available  today  or  in  the  near  future? 


For  the  simplest  case,  the  one  to  which  we  have  limited  ourselves  so  far, 
with  a  single  object  with  no  internal  d.f.’s,  can  probablybe  handled 
computationally.  But  does  this  remain  true  if  we  allow  more  than  one  object,  k>l, 
and/or  internal  d.f.’s  ,  d>3?  I  hope  that  this  is  made  possible  by  the  factoring  of 
the  problem,  but  at  present  this  is  only  a  guess,  perhaps  wishful  thinking. 

The  only  way  to  find  out  if  this  is  possible  is  to  try  it  on  real  pictures  from 
our  car  experiment.  I  therefore  suggest  that  we  do  this  during  the  current 
academic  year,  at  first  only  for  k»l,  d«3,  to  firm  up  the  model  and  algorithm,  and 
if  the  results  look  promising,  that  we  go  on  to  the  general  case.  I  do  not  mean 
that  we  should  just  carry  out  a  large  scale  computer  experiment,  but  that  we  also 
pay  attention  to  the  analytical  issues  that  are  only  superficially  discussed  above. 
Doing  this,  we  may  learn  that  substantial  modification  is  needed,  perhaps 
oversights  have  to  be  corrected,  and  better  heuristics  invented. 

I  hope  that  our  group  will  decide  to  undertake  this  ambitious  study.  We 
would  then  have  to  divide  up  the  work  among  ourselves  to  achieve  a  cohesive 


team  effort. 


